2023-02-12 06:02:34,436 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-12 06:02:34,486 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=240, MaxFileDescriptor=60000, SystemLoadAverage=154, ProcessCount=166, AvailableMemoryMB=5610 2023-02-12 06:02:34,759 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7 2023-02-12 06:02:34,766 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-12 06:02:34,766 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7/cluster_c92385aa-bc56-4d3f-e0f4-47a0181104fa, deleteOnExit=true 2023-02-12 06:02:34,767 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-12 06:02:34,767 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7/test.cache.data in system properties and HBase conf 2023-02-12 06:02:34,768 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7/hadoop.tmp.dir in system properties and HBase conf 2023-02-12 06:02:34,768 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7/hadoop.log.dir in system properties and HBase conf 2023-02-12 06:02:34,769 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-12 06:02:34,769 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-12 06:02:34,769 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-12 06:02:34,893 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-12 06:02:35,314 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-12 06:02:35,319 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-12 06:02:35,320 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-12 06:02:35,320 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-12 06:02:35,320 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 06:02:35,320 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-12 06:02:35,321 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-12 06:02:35,321 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 06:02:35,321 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 06:02:35,322 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-12 06:02:35,322 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7/nfs.dump.dir in system properties and HBase conf 2023-02-12 06:02:35,323 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7/java.io.tmpdir in system properties and HBase conf 2023-02-12 06:02:35,323 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 06:02:35,323 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-12 06:02:35,323 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-12 06:02:35,855 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 06:02:35,862 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 06:02:36,227 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-12 06:02:36,432 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-12 06:02:36,452 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 06:02:36,499 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 06:02:36,537 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7/java.io.tmpdir/Jetty_localhost_44849_hdfs____ujaajr/webapp 2023-02-12 06:02:36,683 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44849 2023-02-12 06:02:36,722 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 06:02:36,722 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 06:02:37,247 WARN [Listener at localhost/38185] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 06:02:37,346 WARN [Listener at localhost/38185] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 06:02:37,374 WARN [Listener at localhost/38185] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 06:02:37,383 INFO [Listener at localhost/38185] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 06:02:37,392 INFO [Listener at localhost/38185] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7/java.io.tmpdir/Jetty_localhost_38813_datanode____spxcn0/webapp 2023-02-12 06:02:37,565 INFO [Listener at localhost/38185] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38813 2023-02-12 06:02:38,006 WARN [Listener at localhost/43821] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 06:02:38,023 WARN [Listener at localhost/43821] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 06:02:38,028 WARN [Listener at localhost/43821] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 06:02:38,030 INFO [Listener at localhost/43821] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 06:02:38,036 INFO [Listener at localhost/43821] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7/java.io.tmpdir/Jetty_localhost_41083_datanode____.5pug7f/webapp 2023-02-12 06:02:38,159 INFO [Listener at localhost/43821] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41083 2023-02-12 06:02:38,169 WARN [Listener at localhost/44119] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 06:02:38,625 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xded503204e9f2a04: Processing first storage report for DS-8bf328a6-2579-4c77-ab2c-d55e47fb452c from datanode 03d78fa7-53d1-4950-a704-f3f7d74a0ad4 2023-02-12 06:02:38,627 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xded503204e9f2a04: from storage DS-8bf328a6-2579-4c77-ab2c-d55e47fb452c node DatanodeRegistration(127.0.0.1:43245, datanodeUuid=03d78fa7-53d1-4950-a704-f3f7d74a0ad4, infoPort=35783, infoSecurePort=0, ipcPort=43821, storageInfo=lv=-57;cid=testClusterID;nsid=1582088661;c=1676181755961), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-02-12 06:02:38,627 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x38625db39e4be443: Processing first storage report for DS-bc5e7324-95f1-4c8d-9249-9c893d177334 from datanode 4c83e6ca-3088-4d38-a8b6-50b097ccbfb2 2023-02-12 06:02:38,627 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x38625db39e4be443: from storage DS-bc5e7324-95f1-4c8d-9249-9c893d177334 node DatanodeRegistration(127.0.0.1:43985, datanodeUuid=4c83e6ca-3088-4d38-a8b6-50b097ccbfb2, infoPort=36087, infoSecurePort=0, ipcPort=44119, storageInfo=lv=-57;cid=testClusterID;nsid=1582088661;c=1676181755961), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 06:02:38,627 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xded503204e9f2a04: Processing first storage report for DS-6f9d49da-5247-4688-8859-4e3d2554fb84 from datanode 03d78fa7-53d1-4950-a704-f3f7d74a0ad4 2023-02-12 06:02:38,627 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xded503204e9f2a04: from storage DS-6f9d49da-5247-4688-8859-4e3d2554fb84 node DatanodeRegistration(127.0.0.1:43245, datanodeUuid=03d78fa7-53d1-4950-a704-f3f7d74a0ad4, infoPort=35783, infoSecurePort=0, ipcPort=43821, storageInfo=lv=-57;cid=testClusterID;nsid=1582088661;c=1676181755961), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 06:02:38,628 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x38625db39e4be443: Processing first storage report for DS-7c6eb0c2-9bea-4316-a19b-e3d144b609ff from datanode 4c83e6ca-3088-4d38-a8b6-50b097ccbfb2 2023-02-12 06:02:38,628 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x38625db39e4be443: from storage DS-7c6eb0c2-9bea-4316-a19b-e3d144b609ff node DatanodeRegistration(127.0.0.1:43985, datanodeUuid=4c83e6ca-3088-4d38-a8b6-50b097ccbfb2, infoPort=36087, infoSecurePort=0, ipcPort=44119, storageInfo=lv=-57;cid=testClusterID;nsid=1582088661;c=1676181755961), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 06:02:38,712 DEBUG [Listener at localhost/44119] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7 2023-02-12 06:02:38,819 INFO [Listener at localhost/44119] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7/cluster_c92385aa-bc56-4d3f-e0f4-47a0181104fa/zookeeper_0, clientPort=56793, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7/cluster_c92385aa-bc56-4d3f-e0f4-47a0181104fa/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7/cluster_c92385aa-bc56-4d3f-e0f4-47a0181104fa/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-12 06:02:38,839 INFO [Listener at localhost/44119] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=56793 2023-02-12 06:02:38,849 INFO [Listener at localhost/44119] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:02:38,852 INFO [Listener at localhost/44119] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:02:39,523 INFO [Listener at localhost/44119] util.FSUtils(479): Created version file at hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec with version=8 2023-02-12 06:02:39,523 INFO [Listener at localhost/44119] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:02:39,525 INFO [Listener at localhost/44119] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:02:39,529 INFO [Listener at localhost/44119] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/hbase-staging 2023-02-12 06:02:39,845 INFO [Listener at localhost/44119] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-12 06:02:40,312 INFO [Listener at localhost/44119] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 06:02:40,345 INFO [Listener at localhost/44119] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:02:40,345 INFO [Listener at localhost/44119] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 06:02:40,345 INFO [Listener at localhost/44119] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 06:02:40,346 INFO [Listener at localhost/44119] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:02:40,346 INFO [Listener at localhost/44119] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 06:02:40,499 INFO [Listener at localhost/44119] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 06:02:40,570 DEBUG [Listener at localhost/44119] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-12 06:02:40,663 INFO [Listener at localhost/44119] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40371 2023-02-12 06:02:40,674 INFO [Listener at localhost/44119] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:02:40,676 INFO [Listener at localhost/44119] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:02:40,703 INFO [Listener at localhost/44119] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40371 connecting to ZooKeeper ensemble=127.0.0.1:56793 2023-02-12 06:02:40,753 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:403710x0, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 06:02:40,756 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:40371-0x100471fcd120000 connected 2023-02-12 06:02:40,789 DEBUG [Listener at localhost/44119] zookeeper.ZKUtil(164): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 06:02:40,789 DEBUG [Listener at localhost/44119] zookeeper.ZKUtil(164): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:02:40,793 DEBUG [Listener at localhost/44119] zookeeper.ZKUtil(164): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 06:02:40,801 DEBUG [Listener at localhost/44119] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40371 2023-02-12 06:02:40,801 DEBUG [Listener at localhost/44119] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40371 2023-02-12 06:02:40,801 DEBUG [Listener at localhost/44119] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40371 2023-02-12 06:02:40,802 DEBUG [Listener at localhost/44119] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40371 2023-02-12 06:02:40,802 DEBUG [Listener at localhost/44119] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40371 2023-02-12 06:02:40,809 INFO [Listener at localhost/44119] master.HMaster(439): hbase.rootdir=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec, hbase.cluster.distributed=false 2023-02-12 06:02:40,919 INFO [Listener at localhost/44119] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 06:02:40,919 INFO [Listener at localhost/44119] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:02:40,920 INFO [Listener at localhost/44119] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 06:02:40,920 INFO [Listener at localhost/44119] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 06:02:40,920 INFO [Listener at localhost/44119] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:02:40,920 INFO [Listener at localhost/44119] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 06:02:40,925 INFO [Listener at localhost/44119] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 06:02:40,929 INFO [Listener at localhost/44119] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33981 2023-02-12 06:02:40,931 INFO [Listener at localhost/44119] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 06:02:40,939 DEBUG [Listener at localhost/44119] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:02:40,940 INFO [Listener at localhost/44119] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:02:40,943 INFO [Listener at localhost/44119] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:02:40,945 INFO [Listener at localhost/44119] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33981 connecting to ZooKeeper ensemble=127.0.0.1:56793 2023-02-12 06:02:40,949 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): regionserver:339810x0, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 06:02:40,950 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:33981-0x100471fcd120001 connected 2023-02-12 06:02:40,950 DEBUG [Listener at localhost/44119] zookeeper.ZKUtil(164): regionserver:33981-0x100471fcd120001, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 06:02:40,952 DEBUG [Listener at localhost/44119] zookeeper.ZKUtil(164): regionserver:33981-0x100471fcd120001, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:02:40,953 DEBUG [Listener at localhost/44119] zookeeper.ZKUtil(164): regionserver:33981-0x100471fcd120001, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 06:02:40,954 DEBUG [Listener at localhost/44119] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33981 2023-02-12 06:02:40,954 DEBUG [Listener at localhost/44119] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33981 2023-02-12 06:02:40,954 DEBUG [Listener at localhost/44119] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33981 2023-02-12 06:02:40,956 DEBUG [Listener at localhost/44119] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33981 2023-02-12 06:02:40,960 DEBUG [Listener at localhost/44119] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33981 2023-02-12 06:02:40,973 INFO [Listener at localhost/44119] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 06:02:40,973 INFO [Listener at localhost/44119] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:02:40,973 INFO [Listener at localhost/44119] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 06:02:40,974 INFO [Listener at localhost/44119] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 06:02:40,974 INFO [Listener at localhost/44119] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:02:40,974 INFO [Listener at localhost/44119] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 06:02:40,975 INFO [Listener at localhost/44119] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 06:02:40,977 INFO [Listener at localhost/44119] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43903 2023-02-12 06:02:40,977 INFO [Listener at localhost/44119] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 06:02:40,980 DEBUG [Listener at localhost/44119] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:02:40,981 INFO [Listener at localhost/44119] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:02:40,982 INFO [Listener at localhost/44119] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:02:40,985 INFO [Listener at localhost/44119] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43903 connecting to ZooKeeper ensemble=127.0.0.1:56793 2023-02-12 06:02:40,991 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): regionserver:439030x0, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 06:02:40,992 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43903-0x100471fcd120002 connected 2023-02-12 06:02:40,992 DEBUG [Listener at localhost/44119] zookeeper.ZKUtil(164): regionserver:43903-0x100471fcd120002, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 06:02:40,993 DEBUG [Listener at localhost/44119] zookeeper.ZKUtil(164): regionserver:43903-0x100471fcd120002, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:02:40,994 DEBUG [Listener at localhost/44119] zookeeper.ZKUtil(164): regionserver:43903-0x100471fcd120002, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 06:02:40,994 DEBUG [Listener at localhost/44119] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43903 2023-02-12 06:02:40,994 DEBUG [Listener at localhost/44119] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43903 2023-02-12 06:02:40,996 DEBUG [Listener at localhost/44119] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43903 2023-02-12 06:02:40,998 DEBUG [Listener at localhost/44119] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43903 2023-02-12 06:02:40,998 DEBUG [Listener at localhost/44119] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43903 2023-02-12 06:02:41,004 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40371,1676181759683 2023-02-12 06:02:41,013 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 06:02:41,015 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40371,1676181759683 2023-02-12 06:02:41,037 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 06:02:41,037 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): regionserver:43903-0x100471fcd120002, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 06:02:41,037 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): regionserver:33981-0x100471fcd120001, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 06:02:41,037 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:02:41,038 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 06:02:41,040 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40371,1676181759683 from backup master directory 2023-02-12 06:02:41,040 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 06:02:41,043 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40371,1676181759683 2023-02-12 06:02:41,043 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 06:02:41,044 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 06:02:41,044 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,40371,1676181759683 2023-02-12 06:02:41,047 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-12 06:02:41,048 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-12 06:02:41,150 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/hbase.id with ID: 87c86f78-218b-4fc9-a50f-6f99370372b8 2023-02-12 06:02:41,190 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:02:41,207 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:02:41,264 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x5955b6aa to 127.0.0.1:56793 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 06:02:41,298 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71017bc6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 06:02:41,321 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 06:02:41,323 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-12 06:02:41,342 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-12 06:02:41,342 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-12 06:02:41,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-12 06:02:41,348 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-12 06:02:41,350 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 06:02:41,385 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/MasterData/data/master/store-tmp 2023-02-12 06:02:41,424 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:41,424 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 06:02:41,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:02:41,425 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:02:41,425 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 06:02:41,425 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:02:41,425 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:02:41,425 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676181761424Disabling compacts and flushes for region at 1676181761424Disabling writes for close at 1676181761425 (+1 ms)Writing region close event to WAL at 1676181761425Closed at 1676181761425 2023-02-12 06:02:41,427 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/MasterData/WALs/jenkins-hbase4.apache.org,40371,1676181759683 2023-02-12 06:02:41,450 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40371%2C1676181759683, suffix=, logDir=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/MasterData/WALs/jenkins-hbase4.apache.org,40371,1676181759683, archiveDir=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/MasterData/oldWALs, maxLogs=10 2023-02-12 06:02:41,509 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43245,DS-8bf328a6-2579-4c77-ab2c-d55e47fb452c,DISK] 2023-02-12 06:02:41,508 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43985,DS-bc5e7324-95f1-4c8d-9249-9c893d177334,DISK] 2023-02-12 06:02:41,516 DEBUG [RS-EventLoopGroup-4-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-12 06:02:41,581 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/MasterData/WALs/jenkins-hbase4.apache.org,40371,1676181759683/jenkins-hbase4.apache.org%2C40371%2C1676181759683.1676181761461 2023-02-12 06:02:41,582 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43985,DS-bc5e7324-95f1-4c8d-9249-9c893d177334,DISK], DatanodeInfoWithStorage[127.0.0.1:43245,DS-8bf328a6-2579-4c77-ab2c-d55e47fb452c,DISK]] 2023-02-12 06:02:41,583 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-12 06:02:41,583 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:41,586 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:02:41,587 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:02:41,651 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:02:41,658 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-12 06:02:41,687 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-12 06:02:41,699 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:41,705 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:02:41,706 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:02:41,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:02:41,725 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:02:41,726 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73553573, jitterRate=0.09603364765644073}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 06:02:41,726 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676181761618Initializing all the Stores at 1676181761621 (+3 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181761621Cleaning up temporary data from old regions at 1676181761712 (+91 ms)Cleaning up detritus from prior splits at 1676181761713 (+1 ms)Region opened successfully at 1676181761726 (+13 ms) 2023-02-12 06:02:41,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-12 06:02:41,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-12 06:02:41,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-12 06:02:41,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-12 06:02:41,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-12 06:02:41,791 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 36 msec 2023-02-12 06:02:41,791 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-12 06:02:41,825 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-12 06:02:41,831 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-12 06:02:41,866 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-12 06:02:41,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-12 06:02:41,875 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-12 06:02:41,883 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-12 06:02:41,889 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-12 06:02:41,893 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:02:41,894 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-12 06:02:41,895 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-12 06:02:41,911 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-12 06:02:41,916 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): regionserver:33981-0x100471fcd120001, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 06:02:41,916 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 06:02:41,916 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): regionserver:43903-0x100471fcd120002, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 06:02:41,916 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:02:41,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,40371,1676181759683, sessionid=0x100471fcd120000, setting cluster-up flag (Was=false) 2023-02-12 06:02:41,934 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:02:41,941 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-12 06:02:41,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40371,1676181759683 2023-02-12 06:02:41,955 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:02:41,961 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-12 06:02:41,962 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40371,1676181759683 2023-02-12 06:02:41,966 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.hbase-snapshot/.tmp 2023-02-12 06:02:42,004 INFO [RS:1;jenkins-hbase4:43903] regionserver.HRegionServer(952): ClusterId : 87c86f78-218b-4fc9-a50f-6f99370372b8 2023-02-12 06:02:42,004 INFO [RS:0;jenkins-hbase4:33981] regionserver.HRegionServer(952): ClusterId : 87c86f78-218b-4fc9-a50f-6f99370372b8 2023-02-12 06:02:42,012 DEBUG [RS:0;jenkins-hbase4:33981] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 06:02:42,012 DEBUG [RS:1;jenkins-hbase4:43903] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 06:02:42,020 DEBUG [RS:1;jenkins-hbase4:43903] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 06:02:42,020 DEBUG [RS:0;jenkins-hbase4:33981] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 06:02:42,020 DEBUG [RS:1;jenkins-hbase4:43903] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 06:02:42,021 DEBUG [RS:0;jenkins-hbase4:33981] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 06:02:42,024 DEBUG [RS:1;jenkins-hbase4:43903] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 06:02:42,024 DEBUG [RS:0;jenkins-hbase4:33981] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 06:02:42,026 DEBUG [RS:1;jenkins-hbase4:43903] zookeeper.ReadOnlyZKClient(139): Connect 0x665a0c5b to 127.0.0.1:56793 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 06:02:42,026 DEBUG [RS:0;jenkins-hbase4:33981] zookeeper.ReadOnlyZKClient(139): Connect 0x64a3a007 to 127.0.0.1:56793 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 06:02:42,037 DEBUG [RS:1;jenkins-hbase4:43903] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@689dfee0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 06:02:42,038 DEBUG [RS:0;jenkins-hbase4:33981] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a6452e3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 06:02:42,038 DEBUG [RS:1;jenkins-hbase4:43903] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ca2672b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 06:02:42,038 DEBUG [RS:0;jenkins-hbase4:33981] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e5bcb77, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 06:02:42,064 DEBUG [RS:0;jenkins-hbase4:33981] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:33981 2023-02-12 06:02:42,064 DEBUG [RS:1;jenkins-hbase4:43903] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:43903 2023-02-12 06:02:42,070 INFO [RS:1;jenkins-hbase4:43903] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 06:02:42,070 INFO [RS:0;jenkins-hbase4:33981] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 06:02:42,071 INFO [RS:0;jenkins-hbase4:33981] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 06:02:42,071 INFO [RS:1;jenkins-hbase4:43903] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 06:02:42,071 DEBUG [RS:0;jenkins-hbase4:33981] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 06:02:42,071 DEBUG [RS:1;jenkins-hbase4:43903] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 06:02:42,074 INFO [RS:0;jenkins-hbase4:33981] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40371,1676181759683 with isa=jenkins-hbase4.apache.org/172.31.14.131:33981, startcode=1676181760918 2023-02-12 06:02:42,074 INFO [RS:1;jenkins-hbase4:43903] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40371,1676181759683 with isa=jenkins-hbase4.apache.org/172.31.14.131:43903, startcode=1676181760972 2023-02-12 06:02:42,094 DEBUG [RS:0;jenkins-hbase4:33981] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 06:02:42,094 DEBUG [RS:1;jenkins-hbase4:43903] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 06:02:42,137 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-12 06:02:42,149 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 06:02:42,149 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 06:02:42,149 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 06:02:42,150 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 06:02:42,150 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-12 06:02:42,150 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:02:42,150 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 06:02:42,150 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:02:42,150 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32805, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 06:02:42,150 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52439, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 06:02:42,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676181792153 2023-02-12 06:02:42,156 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-12 06:02:42,160 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 06:02:42,161 INFO [PEWorker-2] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-12 06:02:42,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2815) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:577) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-12 06:02:42,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40371] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2815) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:577) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-12 06:02:42,167 INFO [PEWorker-2] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 06:02:42,168 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-12 06:02:42,176 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-12 06:02:42,176 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-12 06:02:42,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-12 06:02:42,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-12 06:02:42,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:42,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-12 06:02:42,183 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-12 06:02:42,183 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-12 06:02:42,186 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-12 06:02:42,186 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-12 06:02:42,188 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676181762188,5,FailOnTimeoutGroup] 2023-02-12 06:02:42,188 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676181762188,5,FailOnTimeoutGroup] 2023-02-12 06:02:42,188 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:42,188 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-12 06:02:42,189 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:42,190 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:42,196 DEBUG [RS:1;jenkins-hbase4:43903] regionserver.HRegionServer(2829): Master is not running yet 2023-02-12 06:02:42,196 DEBUG [RS:0;jenkins-hbase4:33981] regionserver.HRegionServer(2829): Master is not running yet 2023-02-12 06:02:42,196 WARN [RS:1;jenkins-hbase4:43903] regionserver.HRegionServer(1031): reportForDuty failed; sleeping 1000 ms and then retrying. 2023-02-12 06:02:42,196 WARN [RS:0;jenkins-hbase4:33981] regionserver.HRegionServer(1031): reportForDuty failed; sleeping 1000 ms and then retrying. 2023-02-12 06:02:42,211 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 06:02:42,212 INFO [PEWorker-2] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 06:02:42,212 INFO [PEWorker-2] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec 2023-02-12 06:02:42,228 DEBUG [PEWorker-2] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:42,230 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 06:02:42,233 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/hbase/meta/1588230740/info 2023-02-12 06:02:42,234 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 06:02:42,235 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:42,236 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 06:02:42,238 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/hbase/meta/1588230740/rep_barrier 2023-02-12 06:02:42,238 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 06:02:42,239 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:42,239 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 06:02:42,241 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/hbase/meta/1588230740/table 2023-02-12 06:02:42,242 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 06:02:42,243 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:42,244 DEBUG [PEWorker-2] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/hbase/meta/1588230740 2023-02-12 06:02:42,245 DEBUG [PEWorker-2] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/hbase/meta/1588230740 2023-02-12 06:02:42,249 DEBUG [PEWorker-2] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 06:02:42,250 DEBUG [PEWorker-2] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 06:02:42,254 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:02:42,255 INFO [PEWorker-2] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62602214, jitterRate=-0.06715431809425354}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 06:02:42,255 DEBUG [PEWorker-2] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676181762228Initializing all the Stores at 1676181762230 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676181762230Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181762230Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676181762230Cleaning up temporary data from old regions at 1676181762247 (+17 ms)Cleaning up detritus from prior splits at 1676181762247Region opened successfully at 1676181762255 (+8 ms) 2023-02-12 06:02:42,255 DEBUG [PEWorker-2] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 06:02:42,255 INFO [PEWorker-2] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 06:02:42,255 DEBUG [PEWorker-2] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 06:02:42,255 DEBUG [PEWorker-2] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 06:02:42,255 DEBUG [PEWorker-2] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 06:02:42,256 INFO [PEWorker-2] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 06:02:42,257 DEBUG [PEWorker-2] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676181762255Disabling compacts and flushes for region at 1676181762255Disabling writes for close at 1676181762255Writing region close event to WAL at 1676181762256 (+1 ms)Closed at 1676181762256 2023-02-12 06:02:42,261 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 06:02:42,262 INFO [PEWorker-2] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-12 06:02:42,271 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-12 06:02:42,282 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-12 06:02:42,284 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-12 06:02:42,435 WARN [jenkins-hbase4:40371] assignment.AssignmentManager(2157): No servers available; cannot place 1 unassigned regions. 2023-02-12 06:02:43,198 INFO [RS:0;jenkins-hbase4:33981] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40371,1676181759683 with isa=jenkins-hbase4.apache.org/172.31.14.131:33981, startcode=1676181760918 2023-02-12 06:02:43,198 INFO [RS:1;jenkins-hbase4:43903] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40371,1676181759683 with isa=jenkins-hbase4.apache.org/172.31.14.131:43903, startcode=1676181760972 2023-02-12 06:02:43,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40371] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:43,204 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:43,211 DEBUG [RS:0;jenkins-hbase4:33981] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec 2023-02-12 06:02:43,211 DEBUG [RS:1;jenkins-hbase4:43903] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec 2023-02-12 06:02:43,211 DEBUG [RS:0;jenkins-hbase4:33981] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38185 2023-02-12 06:02:43,211 DEBUG [RS:1;jenkins-hbase4:43903] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:38185 2023-02-12 06:02:43,211 DEBUG [RS:0;jenkins-hbase4:33981] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 06:02:43,212 DEBUG [RS:1;jenkins-hbase4:43903] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 06:02:43,220 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 06:02:43,221 DEBUG [RS:0;jenkins-hbase4:33981] zookeeper.ZKUtil(162): regionserver:33981-0x100471fcd120001, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:43,221 DEBUG [RS:1;jenkins-hbase4:43903] zookeeper.ZKUtil(162): regionserver:43903-0x100471fcd120002, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:43,221 WARN [RS:0;jenkins-hbase4:33981] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 06:02:43,221 WARN [RS:1;jenkins-hbase4:43903] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 06:02:43,222 INFO [RS:0;jenkins-hbase4:33981] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 06:02:43,222 INFO [RS:1;jenkins-hbase4:43903] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 06:02:43,222 DEBUG [RS:0;jenkins-hbase4:33981] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/WALs/jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:43,222 DEBUG [RS:1;jenkins-hbase4:43903] regionserver.HRegionServer(1947): logDir=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/WALs/jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:43,223 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43903,1676181760972] 2023-02-12 06:02:43,223 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33981,1676181760918] 2023-02-12 06:02:43,233 DEBUG [RS:1;jenkins-hbase4:43903] zookeeper.ZKUtil(162): regionserver:43903-0x100471fcd120002, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:43,233 DEBUG [RS:0;jenkins-hbase4:33981] zookeeper.ZKUtil(162): regionserver:33981-0x100471fcd120001, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:43,234 DEBUG [RS:1;jenkins-hbase4:43903] zookeeper.ZKUtil(162): regionserver:43903-0x100471fcd120002, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:43,234 DEBUG [RS:0;jenkins-hbase4:33981] zookeeper.ZKUtil(162): regionserver:33981-0x100471fcd120001, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:43,246 DEBUG [RS:1;jenkins-hbase4:43903] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 06:02:43,246 DEBUG [RS:0;jenkins-hbase4:33981] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 06:02:43,256 INFO [RS:1;jenkins-hbase4:43903] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 06:02:43,256 INFO [RS:0;jenkins-hbase4:33981] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 06:02:43,278 INFO [RS:0;jenkins-hbase4:33981] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 06:02:43,278 INFO [RS:1;jenkins-hbase4:43903] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 06:02:43,282 INFO [RS:1;jenkins-hbase4:43903] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 06:02:43,282 INFO [RS:0;jenkins-hbase4:33981] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 06:02:43,283 INFO [RS:1;jenkins-hbase4:43903] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:43,283 INFO [RS:0;jenkins-hbase4:33981] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:43,284 INFO [RS:1;jenkins-hbase4:43903] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 06:02:43,284 INFO [RS:0;jenkins-hbase4:33981] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 06:02:43,292 INFO [RS:0;jenkins-hbase4:33981] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:43,292 INFO [RS:1;jenkins-hbase4:43903] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:43,293 DEBUG [RS:0;jenkins-hbase4:33981] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:02:43,293 DEBUG [RS:1;jenkins-hbase4:43903] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:02:43,293 DEBUG [RS:0;jenkins-hbase4:33981] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:02:43,293 DEBUG [RS:1;jenkins-hbase4:43903] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:02:43,293 DEBUG [RS:0;jenkins-hbase4:33981] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:02:43,293 DEBUG [RS:1;jenkins-hbase4:43903] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:02:43,293 DEBUG [RS:0;jenkins-hbase4:33981] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:02:43,293 DEBUG [RS:1;jenkins-hbase4:43903] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:02:43,293 DEBUG [RS:0;jenkins-hbase4:33981] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:02:43,293 DEBUG [RS:1;jenkins-hbase4:43903] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:02:43,293 DEBUG [RS:0;jenkins-hbase4:33981] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 06:02:43,294 DEBUG [RS:1;jenkins-hbase4:43903] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 06:02:43,294 DEBUG [RS:0;jenkins-hbase4:33981] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:02:43,294 DEBUG [RS:1;jenkins-hbase4:43903] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:02:43,294 DEBUG [RS:0;jenkins-hbase4:33981] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:02:43,294 DEBUG [RS:1;jenkins-hbase4:43903] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:02:43,294 DEBUG [RS:0;jenkins-hbase4:33981] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:02:43,294 DEBUG [RS:1;jenkins-hbase4:43903] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:02:43,294 DEBUG [RS:0;jenkins-hbase4:33981] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:02:43,294 DEBUG [RS:1;jenkins-hbase4:43903] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:02:43,296 INFO [RS:1;jenkins-hbase4:43903] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:43,296 INFO [RS:1;jenkins-hbase4:43903] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:43,296 INFO [RS:1;jenkins-hbase4:43903] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:43,297 INFO [RS:0;jenkins-hbase4:33981] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:43,297 INFO [RS:0;jenkins-hbase4:33981] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:43,297 INFO [RS:0;jenkins-hbase4:33981] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:43,314 INFO [RS:1;jenkins-hbase4:43903] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 06:02:43,314 INFO [RS:0;jenkins-hbase4:33981] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 06:02:43,317 INFO [RS:1;jenkins-hbase4:43903] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43903,1676181760972-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:43,317 INFO [RS:0;jenkins-hbase4:33981] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33981,1676181760918-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:43,336 INFO [RS:1;jenkins-hbase4:43903] regionserver.Replication(203): jenkins-hbase4.apache.org,43903,1676181760972 started 2023-02-12 06:02:43,336 INFO [RS:1;jenkins-hbase4:43903] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,43903,1676181760972, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43903, sessionid=0x100471fcd120002 2023-02-12 06:02:43,337 DEBUG [RS:1;jenkins-hbase4:43903] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 06:02:43,337 DEBUG [RS:1;jenkins-hbase4:43903] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:43,337 DEBUG [RS:1;jenkins-hbase4:43903] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43903,1676181760972' 2023-02-12 06:02:43,337 DEBUG [RS:1;jenkins-hbase4:43903] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:02:43,337 DEBUG [RS:1;jenkins-hbase4:43903] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:02:43,338 DEBUG [RS:1;jenkins-hbase4:43903] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 06:02:43,338 DEBUG [RS:1;jenkins-hbase4:43903] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 06:02:43,338 DEBUG [RS:1;jenkins-hbase4:43903] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:43,338 DEBUG [RS:1;jenkins-hbase4:43903] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43903,1676181760972' 2023-02-12 06:02:43,338 DEBUG [RS:1;jenkins-hbase4:43903] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:02:43,339 DEBUG [RS:1;jenkins-hbase4:43903] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:02:43,339 DEBUG [RS:1;jenkins-hbase4:43903] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 06:02:43,339 INFO [RS:1;jenkins-hbase4:43903] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 06:02:43,340 INFO [RS:1;jenkins-hbase4:43903] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 06:02:43,340 INFO [RS:0;jenkins-hbase4:33981] regionserver.Replication(203): jenkins-hbase4.apache.org,33981,1676181760918 started 2023-02-12 06:02:43,340 INFO [RS:0;jenkins-hbase4:33981] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,33981,1676181760918, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33981, sessionid=0x100471fcd120001 2023-02-12 06:02:43,340 DEBUG [RS:0;jenkins-hbase4:33981] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 06:02:43,340 DEBUG [RS:0;jenkins-hbase4:33981] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:43,340 DEBUG [RS:0;jenkins-hbase4:33981] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33981,1676181760918' 2023-02-12 06:02:43,341 DEBUG [RS:0;jenkins-hbase4:33981] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:02:43,341 DEBUG [RS:0;jenkins-hbase4:33981] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:02:43,342 DEBUG [RS:0;jenkins-hbase4:33981] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 06:02:43,342 DEBUG [RS:0;jenkins-hbase4:33981] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 06:02:43,342 DEBUG [RS:0;jenkins-hbase4:33981] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:43,342 DEBUG [RS:0;jenkins-hbase4:33981] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33981,1676181760918' 2023-02-12 06:02:43,342 DEBUG [RS:0;jenkins-hbase4:33981] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:02:43,343 DEBUG [RS:0;jenkins-hbase4:33981] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:02:43,343 DEBUG [RS:0;jenkins-hbase4:33981] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 06:02:43,343 INFO [RS:0;jenkins-hbase4:33981] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 06:02:43,344 INFO [RS:0;jenkins-hbase4:33981] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 06:02:43,437 DEBUG [jenkins-hbase4:40371] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-12 06:02:43,443 DEBUG [jenkins-hbase4:40371] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 06:02:43,450 DEBUG [jenkins-hbase4:40371] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 06:02:43,450 DEBUG [jenkins-hbase4:40371] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 06:02:43,450 DEBUG [jenkins-hbase4:40371] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 06:02:43,460 INFO [PEWorker-1] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43903,1676181760972, state=OPENING 2023-02-12 06:02:43,468 DEBUG [PEWorker-1] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-12 06:02:43,470 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:02:43,470 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 06:02:43,474 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43903,1676181760972}] 2023-02-12 06:02:43,702 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:43,705 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 06:02:43,709 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46014, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 06:02:43,725 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-12 06:02:43,725 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 06:02:43,729 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43903%2C1676181760972.meta, suffix=.meta, logDir=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/WALs/jenkins-hbase4.apache.org,43903,1676181760972, archiveDir=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/oldWALs, maxLogs=32 2023-02-12 06:02:43,760 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43985,DS-bc5e7324-95f1-4c8d-9249-9c893d177334,DISK] 2023-02-12 06:02:43,760 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43245,DS-8bf328a6-2579-4c77-ab2c-d55e47fb452c,DISK] 2023-02-12 06:02:43,767 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/WALs/jenkins-hbase4.apache.org,43903,1676181760972/jenkins-hbase4.apache.org%2C43903%2C1676181760972.meta.1676181763734.meta 2023-02-12 06:02:43,768 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43985,DS-bc5e7324-95f1-4c8d-9249-9c893d177334,DISK], DatanodeInfoWithStorage[127.0.0.1:43245,DS-8bf328a6-2579-4c77-ab2c-d55e47fb452c,DISK]] 2023-02-12 06:02:43,768 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-12 06:02:43,770 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-12 06:02:43,796 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-12 06:02:43,803 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-12 06:02:43,811 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-12 06:02:43,811 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:43,811 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-12 06:02:43,811 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-12 06:02:43,815 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 06:02:43,817 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/hbase/meta/1588230740/info 2023-02-12 06:02:43,818 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/hbase/meta/1588230740/info 2023-02-12 06:02:43,818 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 06:02:43,819 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:43,819 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 06:02:43,821 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/hbase/meta/1588230740/rep_barrier 2023-02-12 06:02:43,821 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/hbase/meta/1588230740/rep_barrier 2023-02-12 06:02:43,822 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 06:02:43,823 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:43,823 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 06:02:43,825 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/hbase/meta/1588230740/table 2023-02-12 06:02:43,825 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/hbase/meta/1588230740/table 2023-02-12 06:02:43,826 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 06:02:43,827 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:43,829 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/hbase/meta/1588230740 2023-02-12 06:02:43,833 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/hbase/meta/1588230740 2023-02-12 06:02:43,838 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 06:02:43,841 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 06:02:43,843 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61582744, jitterRate=-0.08234560489654541}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 06:02:43,843 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676181763812Writing region info on filesystem at 1676181763812Initializing all the Stores at 1676181763815 (+3 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676181763815Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181763815Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676181763815Cleaning up temporary data from old regions at 1676181763835 (+20 ms)Cleaning up detritus from prior splits at 1676181763836 (+1 ms)Running coprocessor post-open hooks at 1676181763843 (+7 ms)Region opened successfully at 1676181763843 2023-02-12 06:02:43,857 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676181763682 2023-02-12 06:02:43,880 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-12 06:02:43,881 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-12 06:02:43,881 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43903,1676181760972, state=OPEN 2023-02-12 06:02:43,884 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-12 06:02:43,885 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 06:02:43,889 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-12 06:02:43,889 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43903,1676181760972 in 410 msec 2023-02-12 06:02:43,895 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-12 06:02:43,895 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 1.6200 sec 2023-02-12 06:02:43,901 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.8660 sec 2023-02-12 06:02:43,901 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676181761032, completionTime=-1 2023-02-12 06:02:43,902 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-12 06:02:43,902 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-12 06:02:43,970 DEBUG [hconnection-0x431d3bf0-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 06:02:43,973 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46026, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 06:02:43,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-12 06:02:43,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676181823990 2023-02-12 06:02:43,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676181883990 2023-02-12 06:02:43,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 88 msec 2023-02-12 06:02:44,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40371,1676181759683-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:44,015 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40371,1676181759683-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:44,015 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40371,1676181759683-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:44,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40371, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:44,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:44,023 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-12 06:02:44,032 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-12 06:02:44,033 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 06:02:44,044 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-12 06:02:44,046 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 06:02:44,049 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 06:02:44,072 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/hbase/namespace/c291c28b895b1ef2c54c1251146821f9 2023-02-12 06:02:44,075 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/hbase/namespace/c291c28b895b1ef2c54c1251146821f9 empty. 2023-02-12 06:02:44,076 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/hbase/namespace/c291c28b895b1ef2c54c1251146821f9 2023-02-12 06:02:44,076 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-12 06:02:44,112 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-12 06:02:44,115 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => c291c28b895b1ef2c54c1251146821f9, NAME => 'hbase:namespace,,1676181764032.c291c28b895b1ef2c54c1251146821f9.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp 2023-02-12 06:02:44,152 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676181764032.c291c28b895b1ef2c54c1251146821f9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:44,152 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing c291c28b895b1ef2c54c1251146821f9, disabling compactions & flushes 2023-02-12 06:02:44,152 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676181764032.c291c28b895b1ef2c54c1251146821f9. 2023-02-12 06:02:44,152 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676181764032.c291c28b895b1ef2c54c1251146821f9. 2023-02-12 06:02:44,152 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676181764032.c291c28b895b1ef2c54c1251146821f9. after waiting 0 ms 2023-02-12 06:02:44,152 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676181764032.c291c28b895b1ef2c54c1251146821f9. 2023-02-12 06:02:44,152 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676181764032.c291c28b895b1ef2c54c1251146821f9. 2023-02-12 06:02:44,152 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for c291c28b895b1ef2c54c1251146821f9: Waiting for close lock at 1676181764152Disabling compacts and flushes for region at 1676181764152Disabling writes for close at 1676181764152Writing region close event to WAL at 1676181764152Closed at 1676181764152 2023-02-12 06:02:44,157 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 06:02:44,175 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676181764032.c291c28b895b1ef2c54c1251146821f9.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676181764161"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181764161"}]},"ts":"1676181764161"} 2023-02-12 06:02:44,211 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 06:02:44,214 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 06:02:44,218 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676181764214"}]},"ts":"1676181764214"} 2023-02-12 06:02:44,250 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-12 06:02:44,254 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 06:02:44,255 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 06:02:44,256 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 06:02:44,256 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 06:02:44,258 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c291c28b895b1ef2c54c1251146821f9, ASSIGN}] 2023-02-12 06:02:44,262 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c291c28b895b1ef2c54c1251146821f9, ASSIGN 2023-02-12 06:02:44,265 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=c291c28b895b1ef2c54c1251146821f9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33981,1676181760918; forceNewPlan=false, retain=false 2023-02-12 06:02:44,353 INFO [RS:0;jenkins-hbase4:33981] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33981%2C1676181760918, suffix=, logDir=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/WALs/jenkins-hbase4.apache.org,33981,1676181760918, archiveDir=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/oldWALs, maxLogs=32 2023-02-12 06:02:44,353 INFO [RS:1;jenkins-hbase4:43903] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43903%2C1676181760972, suffix=, logDir=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/WALs/jenkins-hbase4.apache.org,43903,1676181760972, archiveDir=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/oldWALs, maxLogs=32 2023-02-12 06:02:44,376 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43985,DS-bc5e7324-95f1-4c8d-9249-9c893d177334,DISK] 2023-02-12 06:02:44,376 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43245,DS-8bf328a6-2579-4c77-ab2c-d55e47fb452c,DISK] 2023-02-12 06:02:44,377 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43245,DS-8bf328a6-2579-4c77-ab2c-d55e47fb452c,DISK] 2023-02-12 06:02:44,378 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43985,DS-bc5e7324-95f1-4c8d-9249-9c893d177334,DISK] 2023-02-12 06:02:44,385 INFO [RS:1;jenkins-hbase4:43903] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/WALs/jenkins-hbase4.apache.org,43903,1676181760972/jenkins-hbase4.apache.org%2C43903%2C1676181760972.1676181764355 2023-02-12 06:02:44,386 DEBUG [RS:1;jenkins-hbase4:43903] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43245,DS-8bf328a6-2579-4c77-ab2c-d55e47fb452c,DISK], DatanodeInfoWithStorage[127.0.0.1:43985,DS-bc5e7324-95f1-4c8d-9249-9c893d177334,DISK]] 2023-02-12 06:02:44,387 INFO [RS:0;jenkins-hbase4:33981] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/WALs/jenkins-hbase4.apache.org,33981,1676181760918/jenkins-hbase4.apache.org%2C33981%2C1676181760918.1676181764354 2023-02-12 06:02:44,388 DEBUG [RS:0;jenkins-hbase4:33981] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43985,DS-bc5e7324-95f1-4c8d-9249-9c893d177334,DISK], DatanodeInfoWithStorage[127.0.0.1:43245,DS-8bf328a6-2579-4c77-ab2c-d55e47fb452c,DISK]] 2023-02-12 06:02:44,417 INFO [jenkins-hbase4:40371] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 06:02:44,418 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c291c28b895b1ef2c54c1251146821f9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:44,418 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676181764032.c291c28b895b1ef2c54c1251146821f9.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676181764418"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181764418"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181764418"}]},"ts":"1676181764418"} 2023-02-12 06:02:44,423 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure c291c28b895b1ef2c54c1251146821f9, server=jenkins-hbase4.apache.org,33981,1676181760918}] 2023-02-12 06:02:44,577 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:44,578 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 06:02:44,582 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50468, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 06:02:44,592 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676181764032.c291c28b895b1ef2c54c1251146821f9. 2023-02-12 06:02:44,592 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c291c28b895b1ef2c54c1251146821f9, NAME => 'hbase:namespace,,1676181764032.c291c28b895b1ef2c54c1251146821f9.', STARTKEY => '', ENDKEY => ''} 2023-02-12 06:02:44,594 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace c291c28b895b1ef2c54c1251146821f9 2023-02-12 06:02:44,594 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676181764032.c291c28b895b1ef2c54c1251146821f9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:44,594 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c291c28b895b1ef2c54c1251146821f9 2023-02-12 06:02:44,594 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c291c28b895b1ef2c54c1251146821f9 2023-02-12 06:02:44,597 INFO [StoreOpener-c291c28b895b1ef2c54c1251146821f9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region c291c28b895b1ef2c54c1251146821f9 2023-02-12 06:02:44,599 DEBUG [StoreOpener-c291c28b895b1ef2c54c1251146821f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/hbase/namespace/c291c28b895b1ef2c54c1251146821f9/info 2023-02-12 06:02:44,599 DEBUG [StoreOpener-c291c28b895b1ef2c54c1251146821f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/hbase/namespace/c291c28b895b1ef2c54c1251146821f9/info 2023-02-12 06:02:44,599 INFO [StoreOpener-c291c28b895b1ef2c54c1251146821f9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c291c28b895b1ef2c54c1251146821f9 columnFamilyName info 2023-02-12 06:02:44,600 INFO [StoreOpener-c291c28b895b1ef2c54c1251146821f9-1] regionserver.HStore(310): Store=c291c28b895b1ef2c54c1251146821f9/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:44,605 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/hbase/namespace/c291c28b895b1ef2c54c1251146821f9 2023-02-12 06:02:44,606 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/hbase/namespace/c291c28b895b1ef2c54c1251146821f9 2023-02-12 06:02:44,611 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c291c28b895b1ef2c54c1251146821f9 2023-02-12 06:02:44,615 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/hbase/namespace/c291c28b895b1ef2c54c1251146821f9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:02:44,616 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c291c28b895b1ef2c54c1251146821f9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60964233, jitterRate=-0.09156213700771332}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 06:02:44,616 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c291c28b895b1ef2c54c1251146821f9: Running coprocessor pre-open hook at 1676181764594Writing region info on filesystem at 1676181764594Initializing all the Stores at 1676181764596 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676181764596Cleaning up temporary data from old regions at 1676181764607 (+11 ms)Cleaning up detritus from prior splits at 1676181764607Running coprocessor post-open hooks at 1676181764616 (+9 ms)Region opened successfully at 1676181764616 2023-02-12 06:02:44,618 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676181764032.c291c28b895b1ef2c54c1251146821f9., pid=6, masterSystemTime=1676181764577 2023-02-12 06:02:44,624 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676181764032.c291c28b895b1ef2c54c1251146821f9. 2023-02-12 06:02:44,624 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676181764032.c291c28b895b1ef2c54c1251146821f9. 2023-02-12 06:02:44,626 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c291c28b895b1ef2c54c1251146821f9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:44,627 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676181764032.c291c28b895b1ef2c54c1251146821f9.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676181764625"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676181764625"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676181764625"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676181764625"}]},"ts":"1676181764625"} 2023-02-12 06:02:44,634 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-12 06:02:44,635 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure c291c28b895b1ef2c54c1251146821f9, server=jenkins-hbase4.apache.org,33981,1676181760918 in 207 msec 2023-02-12 06:02:44,638 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-12 06:02:44,639 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=c291c28b895b1ef2c54c1251146821f9, ASSIGN in 377 msec 2023-02-12 06:02:44,640 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 06:02:44,641 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676181764640"}]},"ts":"1676181764640"} 2023-02-12 06:02:44,644 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-12 06:02:44,649 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-12 06:02:44,649 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 06:02:44,650 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-12 06:02:44,650 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:02:44,652 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 615 msec 2023-02-12 06:02:44,675 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 06:02:44,681 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50472, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 06:02:44,695 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-12 06:02:44,712 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 06:02:44,718 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 32 msec 2023-02-12 06:02:44,737 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-12 06:02:44,750 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 06:02:44,757 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 27 msec 2023-02-12 06:02:44,764 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-12 06:02:44,767 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-12 06:02:44,767 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 3.723sec 2023-02-12 06:02:44,770 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-12 06:02:44,773 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-12 06:02:44,773 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-12 06:02:44,774 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40371,1676181759683-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-12 06:02:44,776 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40371,1676181759683-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-12 06:02:44,785 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-12 06:02:44,810 DEBUG [Listener at localhost/44119] zookeeper.ReadOnlyZKClient(139): Connect 0x4104c894 to 127.0.0.1:56793 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 06:02:44,815 DEBUG [Listener at localhost/44119] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@492f2b89, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 06:02:44,855 DEBUG [hconnection-0x43c02d29-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 06:02:44,870 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46030, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 06:02:44,882 INFO [Listener at localhost/44119] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40371,1676181759683 2023-02-12 06:02:44,882 DEBUG [Listener at localhost/44119] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-12 06:02:44,892 DEBUG [Listener at localhost/44119] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 06:02:44,894 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56276, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 06:02:44,899 INFO [Listener at localhost/44119] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-12 06:02:44,905 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-12 06:02:44,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-12 06:02:44,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 76 connection: 172.31.14.131:56276 deadline: 1676181824903, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-12 06:02:44,907 INFO [Listener at localhost/44119] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-12 06:02:44,923 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 06:02:44,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-12 06:02:44,929 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 06:02:44,932 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 06:02:44,935 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-12 06:02:44,954 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/8179ea2f8e67c4dfba2d173b7540832f 2023-02-12 06:02:44,955 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2 2023-02-12 06:02:44,955 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976 2023-02-12 06:02:44,956 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca 2023-02-12 06:02:44,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 06:02:44,956 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e 2023-02-12 06:02:44,955 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c 2023-02-12 06:02:44,955 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1 2023-02-12 06:02:44,955 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d 2023-02-12 06:02:44,956 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/8179ea2f8e67c4dfba2d173b7540832f empty. 2023-02-12 06:02:44,957 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976 empty. 2023-02-12 06:02:44,958 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e empty. 2023-02-12 06:02:44,956 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2 empty. 2023-02-12 06:02:44,958 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1 empty. 2023-02-12 06:02:44,958 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d empty. 2023-02-12 06:02:44,958 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca empty. 2023-02-12 06:02:44,957 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c empty. 2023-02-12 06:02:44,959 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/8179ea2f8e67c4dfba2d173b7540832f 2023-02-12 06:02:44,960 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592 2023-02-12 06:02:44,960 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e 2023-02-12 06:02:44,960 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/e5810b3e54afabb05e70eb1e55b617c0 2023-02-12 06:02:44,960 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca 2023-02-12 06:02:44,961 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d 2023-02-12 06:02:44,961 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2 2023-02-12 06:02:44,962 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1 2023-02-12 06:02:44,962 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976 2023-02-12 06:02:44,962 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/e5810b3e54afabb05e70eb1e55b617c0 empty. 2023-02-12 06:02:44,962 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592 empty. 2023-02-12 06:02:44,963 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c 2023-02-12 06:02:44,963 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/e5810b3e54afabb05e70eb1e55b617c0 2023-02-12 06:02:44,963 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592 2023-02-12 06:02:44,963 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-12 06:02:44,992 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-12 06:02:44,994 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 8179ea2f8e67c4dfba2d173b7540832f, NAME => 'testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp 2023-02-12 06:02:44,995 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 318c101741f622a7a64c9c89324799b2, NAME => 'testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp 2023-02-12 06:02:44,996 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => a108e70c13825ee3f5ff04e1a1a26976, NAME => 'testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp 2023-02-12 06:02:45,053 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:45,054 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 318c101741f622a7a64c9c89324799b2, disabling compactions & flushes 2023-02-12 06:02:45,054 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2. 2023-02-12 06:02:45,054 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2. 2023-02-12 06:02:45,054 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2. after waiting 0 ms 2023-02-12 06:02:45,054 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2. 2023-02-12 06:02:45,054 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2. 2023-02-12 06:02:45,055 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 318c101741f622a7a64c9c89324799b2: Waiting for close lock at 1676181765054Disabling compacts and flushes for region at 1676181765054Disabling writes for close at 1676181765054Writing region close event to WAL at 1676181765054Closed at 1676181765054 2023-02-12 06:02:45,056 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => a628981a708add40d0832641d94930a1, NAME => 'testWithMapReduce,g\xA7\xA7,1676181764917.a628981a708add40d0832641d94930a1.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp 2023-02-12 06:02:45,056 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:45,057 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing a108e70c13825ee3f5ff04e1a1a26976, disabling compactions & flushes 2023-02-12 06:02:45,057 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976. 2023-02-12 06:02:45,058 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976. 2023-02-12 06:02:45,058 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976. after waiting 0 ms 2023-02-12 06:02:45,058 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976. 2023-02-12 06:02:45,058 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976. 2023-02-12 06:02:45,058 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for a108e70c13825ee3f5ff04e1a1a26976: Waiting for close lock at 1676181765057Disabling compacts and flushes for region at 1676181765057Disabling writes for close at 1676181765058 (+1 ms)Writing region close event to WAL at 1676181765058Closed at 1676181765058 2023-02-12 06:02:45,059 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => ede1a2ead4c611c9c8e6e77d11191a1d, NAME => 'testWithMapReduce,j\xCA\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp 2023-02-12 06:02:45,060 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:45,060 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 8179ea2f8e67c4dfba2d173b7540832f, disabling compactions & flushes 2023-02-12 06:02:45,060 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f. 2023-02-12 06:02:45,060 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f. 2023-02-12 06:02:45,061 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f. after waiting 0 ms 2023-02-12 06:02:45,061 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f. 2023-02-12 06:02:45,061 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f. 2023-02-12 06:02:45,061 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 8179ea2f8e67c4dfba2d173b7540832f: Waiting for close lock at 1676181765060Disabling compacts and flushes for region at 1676181765060Disabling writes for close at 1676181765061 (+1 ms)Writing region close event to WAL at 1676181765061Closed at 1676181765061 2023-02-12 06:02:45,063 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 9d3a93d53da6320c4938e8cef9659b7c, NAME => 'testWithMapReduce,m\xED\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp 2023-02-12 06:02:45,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 06:02:45,088 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676181764917.a628981a708add40d0832641d94930a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:45,089 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing a628981a708add40d0832641d94930a1, disabling compactions & flushes 2023-02-12 06:02:45,089 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676181764917.a628981a708add40d0832641d94930a1. 2023-02-12 06:02:45,089 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676181764917.a628981a708add40d0832641d94930a1. 2023-02-12 06:02:45,089 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676181764917.a628981a708add40d0832641d94930a1. after waiting 0 ms 2023-02-12 06:02:45,089 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676181764917.a628981a708add40d0832641d94930a1. 2023-02-12 06:02:45,089 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676181764917.a628981a708add40d0832641d94930a1. 2023-02-12 06:02:45,089 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for a628981a708add40d0832641d94930a1: Waiting for close lock at 1676181765089Disabling compacts and flushes for region at 1676181765089Disabling writes for close at 1676181765089Writing region close event to WAL at 1676181765089Closed at 1676181765089 2023-02-12 06:02:45,090 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 305521ef65605b0ecbb78cb79cda5d7e, NAME => 'testWithMapReduce,q\x11\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp 2023-02-12 06:02:45,113 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:45,113 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 9d3a93d53da6320c4938e8cef9659b7c, disabling compactions & flushes 2023-02-12 06:02:45,114 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c. 2023-02-12 06:02:45,114 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c. 2023-02-12 06:02:45,114 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c. after waiting 0 ms 2023-02-12 06:02:45,114 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c. 2023-02-12 06:02:45,114 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c. 2023-02-12 06:02:45,114 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 9d3a93d53da6320c4938e8cef9659b7c: Waiting for close lock at 1676181765113Disabling compacts and flushes for region at 1676181765113Disabling writes for close at 1676181765114 (+1 ms)Writing region close event to WAL at 1676181765114Closed at 1676181765114 2023-02-12 06:02:45,114 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5f4fabd8d4e0ff0b3e3d8eab4c9899ca, NAME => 'testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp 2023-02-12 06:02:45,121 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:45,122 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing ede1a2ead4c611c9c8e6e77d11191a1d, disabling compactions & flushes 2023-02-12 06:02:45,122 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d. 2023-02-12 06:02:45,122 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d. 2023-02-12 06:02:45,123 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d. after waiting 0 ms 2023-02-12 06:02:45,123 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d. 2023-02-12 06:02:45,123 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d. 2023-02-12 06:02:45,123 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for ede1a2ead4c611c9c8e6e77d11191a1d: Waiting for close lock at 1676181765122Disabling compacts and flushes for region at 1676181765122Disabling writes for close at 1676181765123 (+1 ms)Writing region close event to WAL at 1676181765123Closed at 1676181765123 2023-02-12 06:02:45,125 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => ce3f693b6332926321d72525ad1f0592, NAME => 'testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp 2023-02-12 06:02:45,142 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:45,143 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 305521ef65605b0ecbb78cb79cda5d7e, disabling compactions & flushes 2023-02-12 06:02:45,143 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e. 2023-02-12 06:02:45,143 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e. 2023-02-12 06:02:45,143 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e. after waiting 0 ms 2023-02-12 06:02:45,143 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e. 2023-02-12 06:02:45,144 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e. 2023-02-12 06:02:45,144 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 305521ef65605b0ecbb78cb79cda5d7e: Waiting for close lock at 1676181765143Disabling compacts and flushes for region at 1676181765143Disabling writes for close at 1676181765143Writing region close event to WAL at 1676181765144 (+1 ms)Closed at 1676181765144 2023-02-12 06:02:45,144 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => e5810b3e54afabb05e70eb1e55b617c0, NAME => 'testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp 2023-02-12 06:02:45,157 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:45,158 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 5f4fabd8d4e0ff0b3e3d8eab4c9899ca, disabling compactions & flushes 2023-02-12 06:02:45,158 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca. 2023-02-12 06:02:45,158 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca. 2023-02-12 06:02:45,158 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca. after waiting 0 ms 2023-02-12 06:02:45,158 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca. 2023-02-12 06:02:45,158 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca. 2023-02-12 06:02:45,158 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 5f4fabd8d4e0ff0b3e3d8eab4c9899ca: Waiting for close lock at 1676181765158Disabling compacts and flushes for region at 1676181765158Disabling writes for close at 1676181765158Writing region close event to WAL at 1676181765158Closed at 1676181765158 2023-02-12 06:02:45,162 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:45,163 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing ce3f693b6332926321d72525ad1f0592, disabling compactions & flushes 2023-02-12 06:02:45,163 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592. 2023-02-12 06:02:45,163 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592. 2023-02-12 06:02:45,163 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592. after waiting 0 ms 2023-02-12 06:02:45,163 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592. 2023-02-12 06:02:45,163 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592. 2023-02-12 06:02:45,164 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for ce3f693b6332926321d72525ad1f0592: Waiting for close lock at 1676181765163Disabling compacts and flushes for region at 1676181765163Disabling writes for close at 1676181765163Writing region close event to WAL at 1676181765163Closed at 1676181765163 2023-02-12 06:02:45,172 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:45,172 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing e5810b3e54afabb05e70eb1e55b617c0, disabling compactions & flushes 2023-02-12 06:02:45,172 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0. 2023-02-12 06:02:45,172 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0. 2023-02-12 06:02:45,172 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0. after waiting 0 ms 2023-02-12 06:02:45,172 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0. 2023-02-12 06:02:45,172 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0. 2023-02-12 06:02:45,173 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for e5810b3e54afabb05e70eb1e55b617c0: Waiting for close lock at 1676181765172Disabling compacts and flushes for region at 1676181765172Disabling writes for close at 1676181765172Writing region close event to WAL at 1676181765172Closed at 1676181765172 2023-02-12 06:02:45,177 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 06:02:45,179 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181765179"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181765179"}]},"ts":"1676181765179"} 2023-02-12 06:02:45,179 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181765179"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181765179"}]},"ts":"1676181765179"} 2023-02-12 06:02:45,180 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676181765179"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181765179"}]},"ts":"1676181765179"} 2023-02-12 06:02:45,180 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676181764917.a628981a708add40d0832641d94930a1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181765179"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181765179"}]},"ts":"1676181765179"} 2023-02-12 06:02:45,180 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181765179"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181765179"}]},"ts":"1676181765179"} 2023-02-12 06:02:45,180 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181765179"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181765179"}]},"ts":"1676181765179"} 2023-02-12 06:02:45,180 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181765179"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181765179"}]},"ts":"1676181765179"} 2023-02-12 06:02:45,180 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181765179"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181765179"}]},"ts":"1676181765179"} 2023-02-12 06:02:45,181 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181765179"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181765179"}]},"ts":"1676181765179"} 2023-02-12 06:02:45,181 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676181765179"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181765179"}]},"ts":"1676181765179"} 2023-02-12 06:02:45,242 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-12 06:02:45,245 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 06:02:45,245 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676181765245"}]},"ts":"1676181765245"} 2023-02-12 06:02:45,247 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-12 06:02:45,253 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 06:02:45,266 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 06:02:45,266 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 06:02:45,266 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 06:02:45,267 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8179ea2f8e67c4dfba2d173b7540832f, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=318c101741f622a7a64c9c89324799b2, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a108e70c13825ee3f5ff04e1a1a26976, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a628981a708add40d0832641d94930a1, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ede1a2ead4c611c9c8e6e77d11191a1d, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9d3a93d53da6320c4938e8cef9659b7c, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=305521ef65605b0ecbb78cb79cda5d7e, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5f4fabd8d4e0ff0b3e3d8eab4c9899ca, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ce3f693b6332926321d72525ad1f0592, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e5810b3e54afabb05e70eb1e55b617c0, ASSIGN}] 2023-02-12 06:02:45,271 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=8179ea2f8e67c4dfba2d173b7540832f, ASSIGN 2023-02-12 06:02:45,271 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=318c101741f622a7a64c9c89324799b2, ASSIGN 2023-02-12 06:02:45,272 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a108e70c13825ee3f5ff04e1a1a26976, ASSIGN 2023-02-12 06:02:45,272 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=a628981a708add40d0832641d94930a1, ASSIGN 2023-02-12 06:02:45,274 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=318c101741f622a7a64c9c89324799b2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43903,1676181760972; forceNewPlan=false, retain=false 2023-02-12 06:02:45,274 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=a108e70c13825ee3f5ff04e1a1a26976, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33981,1676181760918; forceNewPlan=false, retain=false 2023-02-12 06:02:45,275 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=8179ea2f8e67c4dfba2d173b7540832f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43903,1676181760972; forceNewPlan=false, retain=false 2023-02-12 06:02:45,275 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=a628981a708add40d0832641d94930a1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33981,1676181760918; forceNewPlan=false, retain=false 2023-02-12 06:02:45,276 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e5810b3e54afabb05e70eb1e55b617c0, ASSIGN 2023-02-12 06:02:45,277 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ce3f693b6332926321d72525ad1f0592, ASSIGN 2023-02-12 06:02:45,277 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5f4fabd8d4e0ff0b3e3d8eab4c9899ca, ASSIGN 2023-02-12 06:02:45,277 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=305521ef65605b0ecbb78cb79cda5d7e, ASSIGN 2023-02-12 06:02:45,277 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=9d3a93d53da6320c4938e8cef9659b7c, ASSIGN 2023-02-12 06:02:45,278 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e5810b3e54afabb05e70eb1e55b617c0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33981,1676181760918; forceNewPlan=false, retain=false 2023-02-12 06:02:45,278 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=ce3f693b6332926321d72525ad1f0592, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43903,1676181760972; forceNewPlan=false, retain=false 2023-02-12 06:02:45,279 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=5f4fabd8d4e0ff0b3e3d8eab4c9899ca, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33981,1676181760918; forceNewPlan=false, retain=false 2023-02-12 06:02:45,279 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=305521ef65605b0ecbb78cb79cda5d7e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43903,1676181760972; forceNewPlan=false, retain=false 2023-02-12 06:02:45,279 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=9d3a93d53da6320c4938e8cef9659b7c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43903,1676181760972; forceNewPlan=false, retain=false 2023-02-12 06:02:45,280 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ede1a2ead4c611c9c8e6e77d11191a1d, ASSIGN 2023-02-12 06:02:45,281 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=ede1a2ead4c611c9c8e6e77d11191a1d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33981,1676181760918; forceNewPlan=false, retain=false 2023-02-12 06:02:45,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 06:02:45,424 INFO [jenkins-hbase4:40371] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-12 06:02:45,428 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=ce3f693b6332926321d72525ad1f0592, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:45,428 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=305521ef65605b0ecbb78cb79cda5d7e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:45,428 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=9d3a93d53da6320c4938e8cef9659b7c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:45,429 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181765428"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181765428"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181765428"}]},"ts":"1676181765428"} 2023-02-12 06:02:45,429 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181765428"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181765428"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181765428"}]},"ts":"1676181765428"} 2023-02-12 06:02:45,429 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181765428"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181765428"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181765428"}]},"ts":"1676181765428"} 2023-02-12 06:02:45,429 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=318c101741f622a7a64c9c89324799b2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:45,429 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=8179ea2f8e67c4dfba2d173b7540832f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:45,429 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181765429"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181765429"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181765429"}]},"ts":"1676181765429"} 2023-02-12 06:02:45,429 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676181765429"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181765429"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181765429"}]},"ts":"1676181765429"} 2023-02-12 06:02:45,433 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=17, state=RUNNABLE; OpenRegionProcedure 305521ef65605b0ecbb78cb79cda5d7e, server=jenkins-hbase4.apache.org,43903,1676181760972}] 2023-02-12 06:02:45,434 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=19, state=RUNNABLE; OpenRegionProcedure ce3f693b6332926321d72525ad1f0592, server=jenkins-hbase4.apache.org,43903,1676181760972}] 2023-02-12 06:02:45,436 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=16, state=RUNNABLE; OpenRegionProcedure 9d3a93d53da6320c4938e8cef9659b7c, server=jenkins-hbase4.apache.org,43903,1676181760972}] 2023-02-12 06:02:45,440 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=12, state=RUNNABLE; OpenRegionProcedure 318c101741f622a7a64c9c89324799b2, server=jenkins-hbase4.apache.org,43903,1676181760972}] 2023-02-12 06:02:45,443 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=11, state=RUNNABLE; OpenRegionProcedure 8179ea2f8e67c4dfba2d173b7540832f, server=jenkins-hbase4.apache.org,43903,1676181760972}] 2023-02-12 06:02:45,444 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=e5810b3e54afabb05e70eb1e55b617c0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:45,444 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676181765444"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181765444"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181765444"}]},"ts":"1676181765444"} 2023-02-12 06:02:45,445 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=ede1a2ead4c611c9c8e6e77d11191a1d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:45,445 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181765445"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181765445"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181765445"}]},"ts":"1676181765445"} 2023-02-12 06:02:45,447 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=20, state=RUNNABLE; OpenRegionProcedure e5810b3e54afabb05e70eb1e55b617c0, server=jenkins-hbase4.apache.org,33981,1676181760918}] 2023-02-12 06:02:45,449 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=a628981a708add40d0832641d94930a1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:45,449 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676181764917.a628981a708add40d0832641d94930a1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181765449"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181765449"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181765449"}]},"ts":"1676181765449"} 2023-02-12 06:02:45,451 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=15, state=RUNNABLE; OpenRegionProcedure ede1a2ead4c611c9c8e6e77d11191a1d, server=jenkins-hbase4.apache.org,33981,1676181760918}] 2023-02-12 06:02:45,452 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=a108e70c13825ee3f5ff04e1a1a26976, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:45,453 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181765452"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181765452"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181765452"}]},"ts":"1676181765452"} 2023-02-12 06:02:45,454 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=14, state=RUNNABLE; OpenRegionProcedure a628981a708add40d0832641d94930a1, server=jenkins-hbase4.apache.org,33981,1676181760918}] 2023-02-12 06:02:45,457 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=13, state=RUNNABLE; OpenRegionProcedure a108e70c13825ee3f5ff04e1a1a26976, server=jenkins-hbase4.apache.org,33981,1676181760918}] 2023-02-12 06:02:45,458 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=5f4fabd8d4e0ff0b3e3d8eab4c9899ca, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:45,458 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181765458"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181765458"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181765458"}]},"ts":"1676181765458"} 2023-02-12 06:02:45,469 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=18, state=RUNNABLE; OpenRegionProcedure 5f4fabd8d4e0ff0b3e3d8eab4c9899ca, server=jenkins-hbase4.apache.org,33981,1676181760918}] 2023-02-12 06:02:45,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 06:02:45,598 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f. 2023-02-12 06:02:45,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8179ea2f8e67c4dfba2d173b7540832f, NAME => 'testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-12 06:02:45,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 8179ea2f8e67c4dfba2d173b7540832f 2023-02-12 06:02:45,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:45,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8179ea2f8e67c4dfba2d173b7540832f 2023-02-12 06:02:45,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8179ea2f8e67c4dfba2d173b7540832f 2023-02-12 06:02:45,609 INFO [StoreOpener-8179ea2f8e67c4dfba2d173b7540832f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8179ea2f8e67c4dfba2d173b7540832f 2023-02-12 06:02:45,609 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976. 2023-02-12 06:02:45,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a108e70c13825ee3f5ff04e1a1a26976, NAME => 'testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-12 06:02:45,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce a108e70c13825ee3f5ff04e1a1a26976 2023-02-12 06:02:45,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:45,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a108e70c13825ee3f5ff04e1a1a26976 2023-02-12 06:02:45,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a108e70c13825ee3f5ff04e1a1a26976 2023-02-12 06:02:45,611 DEBUG [StoreOpener-8179ea2f8e67c4dfba2d173b7540832f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/8179ea2f8e67c4dfba2d173b7540832f/f1 2023-02-12 06:02:45,612 DEBUG [StoreOpener-8179ea2f8e67c4dfba2d173b7540832f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/8179ea2f8e67c4dfba2d173b7540832f/f1 2023-02-12 06:02:45,612 INFO [StoreOpener-a108e70c13825ee3f5ff04e1a1a26976-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a108e70c13825ee3f5ff04e1a1a26976 2023-02-12 06:02:45,612 INFO [StoreOpener-8179ea2f8e67c4dfba2d173b7540832f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8179ea2f8e67c4dfba2d173b7540832f columnFamilyName f1 2023-02-12 06:02:45,613 INFO [StoreOpener-8179ea2f8e67c4dfba2d173b7540832f-1] regionserver.HStore(310): Store=8179ea2f8e67c4dfba2d173b7540832f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:45,613 INFO [StoreOpener-8179ea2f8e67c4dfba2d173b7540832f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8179ea2f8e67c4dfba2d173b7540832f 2023-02-12 06:02:45,614 DEBUG [StoreOpener-a108e70c13825ee3f5ff04e1a1a26976-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/f1 2023-02-12 06:02:45,615 DEBUG [StoreOpener-a108e70c13825ee3f5ff04e1a1a26976-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/f1 2023-02-12 06:02:45,615 INFO [StoreOpener-a108e70c13825ee3f5ff04e1a1a26976-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a108e70c13825ee3f5ff04e1a1a26976 columnFamilyName f1 2023-02-12 06:02:45,616 DEBUG [StoreOpener-8179ea2f8e67c4dfba2d173b7540832f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/8179ea2f8e67c4dfba2d173b7540832f/f2 2023-02-12 06:02:45,616 DEBUG [StoreOpener-8179ea2f8e67c4dfba2d173b7540832f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/8179ea2f8e67c4dfba2d173b7540832f/f2 2023-02-12 06:02:45,616 INFO [StoreOpener-a108e70c13825ee3f5ff04e1a1a26976-1] regionserver.HStore(310): Store=a108e70c13825ee3f5ff04e1a1a26976/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:45,616 INFO [StoreOpener-a108e70c13825ee3f5ff04e1a1a26976-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a108e70c13825ee3f5ff04e1a1a26976 2023-02-12 06:02:45,617 INFO [StoreOpener-8179ea2f8e67c4dfba2d173b7540832f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8179ea2f8e67c4dfba2d173b7540832f columnFamilyName f2 2023-02-12 06:02:45,618 INFO [StoreOpener-8179ea2f8e67c4dfba2d173b7540832f-1] regionserver.HStore(310): Store=8179ea2f8e67c4dfba2d173b7540832f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:45,619 DEBUG [StoreOpener-a108e70c13825ee3f5ff04e1a1a26976-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/f2 2023-02-12 06:02:45,619 DEBUG [StoreOpener-a108e70c13825ee3f5ff04e1a1a26976-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/f2 2023-02-12 06:02:45,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/8179ea2f8e67c4dfba2d173b7540832f 2023-02-12 06:02:45,620 INFO [StoreOpener-a108e70c13825ee3f5ff04e1a1a26976-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a108e70c13825ee3f5ff04e1a1a26976 columnFamilyName f2 2023-02-12 06:02:45,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/8179ea2f8e67c4dfba2d173b7540832f 2023-02-12 06:02:45,621 INFO [StoreOpener-a108e70c13825ee3f5ff04e1a1a26976-1] regionserver.HStore(310): Store=a108e70c13825ee3f5ff04e1a1a26976/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:45,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976 2023-02-12 06:02:45,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976 2023-02-12 06:02:45,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:02:45,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8179ea2f8e67c4dfba2d173b7540832f 2023-02-12 06:02:45,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/8179ea2f8e67c4dfba2d173b7540832f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:02:45,630 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8179ea2f8e67c4dfba2d173b7540832f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72896532, jitterRate=0.08624297380447388}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:02:45,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8179ea2f8e67c4dfba2d173b7540832f: Running coprocessor pre-open hook at 1676181765599Writing region info on filesystem at 1676181765599Initializing all the Stores at 1676181765604 (+5 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181765604Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181765608 (+4 ms)Cleaning up temporary data from old regions at 1676181765622 (+14 ms)Cleaning up detritus from prior splits at 1676181765622Running coprocessor post-open hooks at 1676181765630 (+8 ms)Region opened successfully at 1676181765630 2023-02-12 06:02:45,631 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f., pid=25, masterSystemTime=1676181765589 2023-02-12 06:02:45,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:02:45,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f. 2023-02-12 06:02:45,635 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f. 2023-02-12 06:02:45,636 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592. 2023-02-12 06:02:45,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ce3f693b6332926321d72525ad1f0592, NAME => 'testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-12 06:02:45,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce ce3f693b6332926321d72525ad1f0592 2023-02-12 06:02:45,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:45,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ce3f693b6332926321d72525ad1f0592 2023-02-12 06:02:45,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ce3f693b6332926321d72525ad1f0592 2023-02-12 06:02:45,639 INFO [StoreOpener-ce3f693b6332926321d72525ad1f0592-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ce3f693b6332926321d72525ad1f0592 2023-02-12 06:02:45,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a108e70c13825ee3f5ff04e1a1a26976 2023-02-12 06:02:45,642 DEBUG [StoreOpener-ce3f693b6332926321d72525ad1f0592-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/f1 2023-02-12 06:02:45,642 DEBUG [StoreOpener-ce3f693b6332926321d72525ad1f0592-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/f1 2023-02-12 06:02:45,643 INFO [StoreOpener-ce3f693b6332926321d72525ad1f0592-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ce3f693b6332926321d72525ad1f0592 columnFamilyName f1 2023-02-12 06:02:45,644 INFO [StoreOpener-ce3f693b6332926321d72525ad1f0592-1] regionserver.HStore(310): Store=ce3f693b6332926321d72525ad1f0592/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:45,645 INFO [StoreOpener-ce3f693b6332926321d72525ad1f0592-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ce3f693b6332926321d72525ad1f0592 2023-02-12 06:02:45,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:02:45,647 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a108e70c13825ee3f5ff04e1a1a26976; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72117737, jitterRate=0.07463802397251129}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:02:45,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a108e70c13825ee3f5ff04e1a1a26976: Running coprocessor pre-open hook at 1676181765610Writing region info on filesystem at 1676181765610Initializing all the Stores at 1676181765612 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181765612Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181765612Cleaning up temporary data from old regions at 1676181765624 (+12 ms)Cleaning up detritus from prior splits at 1676181765632 (+8 ms)Running coprocessor post-open hooks at 1676181765647 (+15 ms)Region opened successfully at 1676181765647 2023-02-12 06:02:45,648 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976., pid=29, masterSystemTime=1676181765604 2023-02-12 06:02:45,648 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=8179ea2f8e67c4dfba2d173b7540832f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:45,649 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676181765648"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676181765648"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676181765648"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676181765648"}]},"ts":"1676181765648"} 2023-02-12 06:02:45,652 DEBUG [StoreOpener-ce3f693b6332926321d72525ad1f0592-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/f2 2023-02-12 06:02:45,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976. 2023-02-12 06:02:45,653 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976. 2023-02-12 06:02:45,653 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676181764917.a628981a708add40d0832641d94930a1. 2023-02-12 06:02:45,652 DEBUG [StoreOpener-ce3f693b6332926321d72525ad1f0592-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/f2 2023-02-12 06:02:45,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a628981a708add40d0832641d94930a1, NAME => 'testWithMapReduce,g\xA7\xA7,1676181764917.a628981a708add40d0832641d94930a1.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-12 06:02:45,653 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=a108e70c13825ee3f5ff04e1a1a26976, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:45,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce a628981a708add40d0832641d94930a1 2023-02-12 06:02:45,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676181764917.a628981a708add40d0832641d94930a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:45,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a628981a708add40d0832641d94930a1 2023-02-12 06:02:45,654 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181765653"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676181765653"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676181765653"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676181765653"}]},"ts":"1676181765653"} 2023-02-12 06:02:45,653 INFO [StoreOpener-ce3f693b6332926321d72525ad1f0592-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ce3f693b6332926321d72525ad1f0592 columnFamilyName f2 2023-02-12 06:02:45,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a628981a708add40d0832641d94930a1 2023-02-12 06:02:45,655 INFO [StoreOpener-ce3f693b6332926321d72525ad1f0592-1] regionserver.HStore(310): Store=ce3f693b6332926321d72525ad1f0592/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:45,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592 2023-02-12 06:02:45,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592 2023-02-12 06:02:45,659 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=11 2023-02-12 06:02:45,659 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=11, state=SUCCESS; OpenRegionProcedure 8179ea2f8e67c4dfba2d173b7540832f, server=jenkins-hbase4.apache.org,43903,1676181760972 in 210 msec 2023-02-12 06:02:45,662 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=8179ea2f8e67c4dfba2d173b7540832f, ASSIGN in 393 msec 2023-02-12 06:02:45,663 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=13 2023-02-12 06:02:45,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:02:45,663 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=13, state=SUCCESS; OpenRegionProcedure a108e70c13825ee3f5ff04e1a1a26976, server=jenkins-hbase4.apache.org,33981,1676181760918 in 202 msec 2023-02-12 06:02:45,664 INFO [StoreOpener-a628981a708add40d0832641d94930a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a628981a708add40d0832641d94930a1 2023-02-12 06:02:45,665 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a108e70c13825ee3f5ff04e1a1a26976, ASSIGN in 397 msec 2023-02-12 06:02:45,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ce3f693b6332926321d72525ad1f0592 2023-02-12 06:02:45,666 DEBUG [StoreOpener-a628981a708add40d0832641d94930a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/f1 2023-02-12 06:02:45,666 DEBUG [StoreOpener-a628981a708add40d0832641d94930a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/f1 2023-02-12 06:02:45,667 INFO [StoreOpener-a628981a708add40d0832641d94930a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a628981a708add40d0832641d94930a1 columnFamilyName f1 2023-02-12 06:02:45,668 INFO [StoreOpener-a628981a708add40d0832641d94930a1-1] regionserver.HStore(310): Store=a628981a708add40d0832641d94930a1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:45,668 INFO [StoreOpener-a628981a708add40d0832641d94930a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a628981a708add40d0832641d94930a1 2023-02-12 06:02:45,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:02:45,670 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ce3f693b6332926321d72525ad1f0592; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67690544, jitterRate=0.008667707443237305}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:02:45,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ce3f693b6332926321d72525ad1f0592: Running coprocessor pre-open hook at 1676181765637Writing region info on filesystem at 1676181765637Initializing all the Stores at 1676181765639 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181765639Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181765639Cleaning up temporary data from old regions at 1676181765660 (+21 ms)Cleaning up detritus from prior splits at 1676181765661 (+1 ms)Running coprocessor post-open hooks at 1676181765670 (+9 ms)Region opened successfully at 1676181765670 2023-02-12 06:02:45,670 DEBUG [StoreOpener-a628981a708add40d0832641d94930a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/f2 2023-02-12 06:02:45,671 DEBUG [StoreOpener-a628981a708add40d0832641d94930a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/f2 2023-02-12 06:02:45,671 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592., pid=22, masterSystemTime=1676181765589 2023-02-12 06:02:45,672 INFO [StoreOpener-a628981a708add40d0832641d94930a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a628981a708add40d0832641d94930a1 columnFamilyName f2 2023-02-12 06:02:45,674 INFO [StoreOpener-a628981a708add40d0832641d94930a1-1] regionserver.HStore(310): Store=a628981a708add40d0832641d94930a1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:45,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592. 2023-02-12 06:02:45,676 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592. 2023-02-12 06:02:45,676 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e. 2023-02-12 06:02:45,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 305521ef65605b0ecbb78cb79cda5d7e, NAME => 'testWithMapReduce,q\x11\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-12 06:02:45,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 305521ef65605b0ecbb78cb79cda5d7e 2023-02-12 06:02:45,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:45,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 305521ef65605b0ecbb78cb79cda5d7e 2023-02-12 06:02:45,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 305521ef65605b0ecbb78cb79cda5d7e 2023-02-12 06:02:45,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1 2023-02-12 06:02:45,678 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=ce3f693b6332926321d72525ad1f0592, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:45,678 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181765677"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676181765677"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676181765677"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676181765677"}]},"ts":"1676181765677"} 2023-02-12 06:02:45,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1 2023-02-12 06:02:45,678 INFO [StoreOpener-305521ef65605b0ecbb78cb79cda5d7e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 305521ef65605b0ecbb78cb79cda5d7e 2023-02-12 06:02:45,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:02:45,686 DEBUG [StoreOpener-305521ef65605b0ecbb78cb79cda5d7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/f1 2023-02-12 06:02:45,686 DEBUG [StoreOpener-305521ef65605b0ecbb78cb79cda5d7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/f1 2023-02-12 06:02:45,687 INFO [StoreOpener-305521ef65605b0ecbb78cb79cda5d7e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 305521ef65605b0ecbb78cb79cda5d7e columnFamilyName f1 2023-02-12 06:02:45,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a628981a708add40d0832641d94930a1 2023-02-12 06:02:45,688 INFO [StoreOpener-305521ef65605b0ecbb78cb79cda5d7e-1] regionserver.HStore(310): Store=305521ef65605b0ecbb78cb79cda5d7e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:45,689 INFO [StoreOpener-305521ef65605b0ecbb78cb79cda5d7e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 305521ef65605b0ecbb78cb79cda5d7e 2023-02-12 06:02:45,711 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=19 2023-02-12 06:02:45,712 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=19, state=SUCCESS; OpenRegionProcedure ce3f693b6332926321d72525ad1f0592, server=jenkins-hbase4.apache.org,43903,1676181760972 in 250 msec 2023-02-12 06:02:45,714 DEBUG [StoreOpener-305521ef65605b0ecbb78cb79cda5d7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/f2 2023-02-12 06:02:45,714 DEBUG [StoreOpener-305521ef65605b0ecbb78cb79cda5d7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/f2 2023-02-12 06:02:45,715 INFO [StoreOpener-305521ef65605b0ecbb78cb79cda5d7e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 305521ef65605b0ecbb78cb79cda5d7e columnFamilyName f2 2023-02-12 06:02:45,715 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ce3f693b6332926321d72525ad1f0592, ASSIGN in 446 msec 2023-02-12 06:02:45,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:02:45,716 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a628981a708add40d0832641d94930a1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68400800, jitterRate=0.019251346588134766}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:02:45,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a628981a708add40d0832641d94930a1: Running coprocessor pre-open hook at 1676181765655Writing region info on filesystem at 1676181765655Initializing all the Stores at 1676181765658 (+3 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181765658Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181765663 (+5 ms)Cleaning up temporary data from old regions at 1676181765681 (+18 ms)Cleaning up detritus from prior splits at 1676181765683 (+2 ms)Running coprocessor post-open hooks at 1676181765716 (+33 ms)Region opened successfully at 1676181765716 2023-02-12 06:02:45,717 INFO [StoreOpener-305521ef65605b0ecbb78cb79cda5d7e-1] regionserver.HStore(310): Store=305521ef65605b0ecbb78cb79cda5d7e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:45,718 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676181764917.a628981a708add40d0832641d94930a1., pid=28, masterSystemTime=1676181765604 2023-02-12 06:02:45,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e 2023-02-12 06:02:45,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e 2023-02-12 06:02:45,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676181764917.a628981a708add40d0832641d94930a1. 2023-02-12 06:02:45,721 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676181764917.a628981a708add40d0832641d94930a1. 2023-02-12 06:02:45,721 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d. 2023-02-12 06:02:45,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ede1a2ead4c611c9c8e6e77d11191a1d, NAME => 'testWithMapReduce,j\xCA\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-12 06:02:45,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce ede1a2ead4c611c9c8e6e77d11191a1d 2023-02-12 06:02:45,722 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=a628981a708add40d0832641d94930a1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:45,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:45,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ede1a2ead4c611c9c8e6e77d11191a1d 2023-02-12 06:02:45,722 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676181764917.a628981a708add40d0832641d94930a1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181765722"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676181765722"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676181765722"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676181765722"}]},"ts":"1676181765722"} 2023-02-12 06:02:45,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ede1a2ead4c611c9c8e6e77d11191a1d 2023-02-12 06:02:45,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:02:45,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 305521ef65605b0ecbb78cb79cda5d7e 2023-02-12 06:02:45,729 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=14 2023-02-12 06:02:45,730 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=14, state=SUCCESS; OpenRegionProcedure a628981a708add40d0832641d94930a1, server=jenkins-hbase4.apache.org,33981,1676181760918 in 272 msec 2023-02-12 06:02:45,731 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a628981a708add40d0832641d94930a1, ASSIGN in 463 msec 2023-02-12 06:02:45,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:02:45,737 INFO [StoreOpener-ede1a2ead4c611c9c8e6e77d11191a1d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ede1a2ead4c611c9c8e6e77d11191a1d 2023-02-12 06:02:45,738 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 305521ef65605b0ecbb78cb79cda5d7e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68036755, jitterRate=0.013826653361320496}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:02:45,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 305521ef65605b0ecbb78cb79cda5d7e: Running coprocessor pre-open hook at 1676181765677Writing region info on filesystem at 1676181765677Initializing all the Stores at 1676181765678 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181765678Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181765678Cleaning up temporary data from old regions at 1676181765721 (+43 ms)Cleaning up detritus from prior splits at 1676181765722 (+1 ms)Running coprocessor post-open hooks at 1676181765738 (+16 ms)Region opened successfully at 1676181765738 2023-02-12 06:02:45,739 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e., pid=21, masterSystemTime=1676181765589 2023-02-12 06:02:45,740 DEBUG [StoreOpener-ede1a2ead4c611c9c8e6e77d11191a1d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/f1 2023-02-12 06:02:45,740 DEBUG [StoreOpener-ede1a2ead4c611c9c8e6e77d11191a1d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/f1 2023-02-12 06:02:45,740 INFO [StoreOpener-ede1a2ead4c611c9c8e6e77d11191a1d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ede1a2ead4c611c9c8e6e77d11191a1d columnFamilyName f1 2023-02-12 06:02:45,741 INFO [StoreOpener-ede1a2ead4c611c9c8e6e77d11191a1d-1] regionserver.HStore(310): Store=ede1a2ead4c611c9c8e6e77d11191a1d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:45,741 INFO [StoreOpener-ede1a2ead4c611c9c8e6e77d11191a1d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ede1a2ead4c611c9c8e6e77d11191a1d 2023-02-12 06:02:45,743 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=305521ef65605b0ecbb78cb79cda5d7e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:45,743 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181765743"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676181765743"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676181765743"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676181765743"}]},"ts":"1676181765743"} 2023-02-12 06:02:45,744 DEBUG [StoreOpener-ede1a2ead4c611c9c8e6e77d11191a1d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/f2 2023-02-12 06:02:45,744 DEBUG [StoreOpener-ede1a2ead4c611c9c8e6e77d11191a1d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/f2 2023-02-12 06:02:45,745 INFO [StoreOpener-ede1a2ead4c611c9c8e6e77d11191a1d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ede1a2ead4c611c9c8e6e77d11191a1d columnFamilyName f2 2023-02-12 06:02:45,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e. 2023-02-12 06:02:45,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e. 2023-02-12 06:02:45,745 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2. 2023-02-12 06:02:45,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 318c101741f622a7a64c9c89324799b2, NAME => 'testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-12 06:02:45,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 318c101741f622a7a64c9c89324799b2 2023-02-12 06:02:45,746 INFO [StoreOpener-ede1a2ead4c611c9c8e6e77d11191a1d-1] regionserver.HStore(310): Store=ede1a2ead4c611c9c8e6e77d11191a1d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:45,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:45,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 318c101741f622a7a64c9c89324799b2 2023-02-12 06:02:45,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 318c101741f622a7a64c9c89324799b2 2023-02-12 06:02:45,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d 2023-02-12 06:02:45,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d 2023-02-12 06:02:45,750 INFO [StoreOpener-318c101741f622a7a64c9c89324799b2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 318c101741f622a7a64c9c89324799b2 2023-02-12 06:02:45,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:02:45,753 DEBUG [StoreOpener-318c101741f622a7a64c9c89324799b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/f1 2023-02-12 06:02:45,753 DEBUG [StoreOpener-318c101741f622a7a64c9c89324799b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/f1 2023-02-12 06:02:45,754 INFO [StoreOpener-318c101741f622a7a64c9c89324799b2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 318c101741f622a7a64c9c89324799b2 columnFamilyName f1 2023-02-12 06:02:45,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ede1a2ead4c611c9c8e6e77d11191a1d 2023-02-12 06:02:45,755 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=17 2023-02-12 06:02:45,755 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=17, state=SUCCESS; OpenRegionProcedure 305521ef65605b0ecbb78cb79cda5d7e, server=jenkins-hbase4.apache.org,43903,1676181760972 in 314 msec 2023-02-12 06:02:45,755 INFO [StoreOpener-318c101741f622a7a64c9c89324799b2-1] regionserver.HStore(310): Store=318c101741f622a7a64c9c89324799b2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:45,755 INFO [StoreOpener-318c101741f622a7a64c9c89324799b2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 318c101741f622a7a64c9c89324799b2 2023-02-12 06:02:45,757 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=305521ef65605b0ecbb78cb79cda5d7e, ASSIGN in 489 msec 2023-02-12 06:02:45,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:02:45,758 DEBUG [StoreOpener-318c101741f622a7a64c9c89324799b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/f2 2023-02-12 06:02:45,759 DEBUG [StoreOpener-318c101741f622a7a64c9c89324799b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/f2 2023-02-12 06:02:45,759 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ede1a2ead4c611c9c8e6e77d11191a1d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73282207, jitterRate=0.09198997914791107}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:02:45,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ede1a2ead4c611c9c8e6e77d11191a1d: Running coprocessor pre-open hook at 1676181765723Writing region info on filesystem at 1676181765723Initializing all the Stores at 1676181765729 (+6 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181765730 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181765737 (+7 ms)Cleaning up temporary data from old regions at 1676181765750 (+13 ms)Cleaning up detritus from prior splits at 1676181765750Running coprocessor post-open hooks at 1676181765759 (+9 ms)Region opened successfully at 1676181765759 2023-02-12 06:02:45,760 INFO [StoreOpener-318c101741f622a7a64c9c89324799b2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 318c101741f622a7a64c9c89324799b2 columnFamilyName f2 2023-02-12 06:02:45,760 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d., pid=27, masterSystemTime=1676181765604 2023-02-12 06:02:45,762 INFO [StoreOpener-318c101741f622a7a64c9c89324799b2-1] regionserver.HStore(310): Store=318c101741f622a7a64c9c89324799b2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:45,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d. 2023-02-12 06:02:45,763 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d. 2023-02-12 06:02:45,763 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0. 2023-02-12 06:02:45,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e5810b3e54afabb05e70eb1e55b617c0, NAME => 'testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-12 06:02:45,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e5810b3e54afabb05e70eb1e55b617c0 2023-02-12 06:02:45,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2 2023-02-12 06:02:45,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:45,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e5810b3e54afabb05e70eb1e55b617c0 2023-02-12 06:02:45,764 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=ede1a2ead4c611c9c8e6e77d11191a1d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:45,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e5810b3e54afabb05e70eb1e55b617c0 2023-02-12 06:02:45,765 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181765764"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676181765764"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676181765764"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676181765764"}]},"ts":"1676181765764"} 2023-02-12 06:02:45,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2 2023-02-12 06:02:45,767 INFO [StoreOpener-e5810b3e54afabb05e70eb1e55b617c0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e5810b3e54afabb05e70eb1e55b617c0 2023-02-12 06:02:45,769 DEBUG [StoreOpener-e5810b3e54afabb05e70eb1e55b617c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/e5810b3e54afabb05e70eb1e55b617c0/f1 2023-02-12 06:02:45,769 DEBUG [StoreOpener-e5810b3e54afabb05e70eb1e55b617c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/e5810b3e54afabb05e70eb1e55b617c0/f1 2023-02-12 06:02:45,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:02:45,770 INFO [StoreOpener-e5810b3e54afabb05e70eb1e55b617c0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e5810b3e54afabb05e70eb1e55b617c0 columnFamilyName f1 2023-02-12 06:02:45,771 INFO [StoreOpener-e5810b3e54afabb05e70eb1e55b617c0-1] regionserver.HStore(310): Store=e5810b3e54afabb05e70eb1e55b617c0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:45,772 INFO [StoreOpener-e5810b3e54afabb05e70eb1e55b617c0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e5810b3e54afabb05e70eb1e55b617c0 2023-02-12 06:02:45,772 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=15 2023-02-12 06:02:45,772 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=15, state=SUCCESS; OpenRegionProcedure ede1a2ead4c611c9c8e6e77d11191a1d, server=jenkins-hbase4.apache.org,33981,1676181760918 in 317 msec 2023-02-12 06:02:45,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 318c101741f622a7a64c9c89324799b2 2023-02-12 06:02:45,774 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ede1a2ead4c611c9c8e6e77d11191a1d, ASSIGN in 506 msec 2023-02-12 06:02:45,774 DEBUG [StoreOpener-e5810b3e54afabb05e70eb1e55b617c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/e5810b3e54afabb05e70eb1e55b617c0/f2 2023-02-12 06:02:45,774 DEBUG [StoreOpener-e5810b3e54afabb05e70eb1e55b617c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/e5810b3e54afabb05e70eb1e55b617c0/f2 2023-02-12 06:02:45,775 INFO [StoreOpener-e5810b3e54afabb05e70eb1e55b617c0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e5810b3e54afabb05e70eb1e55b617c0 columnFamilyName f2 2023-02-12 06:02:45,776 INFO [StoreOpener-e5810b3e54afabb05e70eb1e55b617c0-1] regionserver.HStore(310): Store=e5810b3e54afabb05e70eb1e55b617c0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:45,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:02:45,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/e5810b3e54afabb05e70eb1e55b617c0 2023-02-12 06:02:45,778 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 318c101741f622a7a64c9c89324799b2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59329148, jitterRate=-0.11592680215835571}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:02:45,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 318c101741f622a7a64c9c89324799b2: Running coprocessor pre-open hook at 1676181765747Writing region info on filesystem at 1676181765747Initializing all the Stores at 1676181765749 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181765749Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181765750 (+1 ms)Cleaning up temporary data from old regions at 1676181765767 (+17 ms)Cleaning up detritus from prior splits at 1676181765769 (+2 ms)Running coprocessor post-open hooks at 1676181765778 (+9 ms)Region opened successfully at 1676181765778 2023-02-12 06:02:45,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/e5810b3e54afabb05e70eb1e55b617c0 2023-02-12 06:02:45,780 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2., pid=24, masterSystemTime=1676181765589 2023-02-12 06:02:45,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:02:45,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2. 2023-02-12 06:02:45,783 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2. 2023-02-12 06:02:45,783 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c. 2023-02-12 06:02:45,783 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=318c101741f622a7a64c9c89324799b2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:45,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9d3a93d53da6320c4938e8cef9659b7c, NAME => 'testWithMapReduce,m\xED\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-12 06:02:45,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 9d3a93d53da6320c4938e8cef9659b7c 2023-02-12 06:02:45,784 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181765783"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676181765783"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676181765783"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676181765783"}]},"ts":"1676181765783"} 2023-02-12 06:02:45,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:45,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 9d3a93d53da6320c4938e8cef9659b7c 2023-02-12 06:02:45,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 9d3a93d53da6320c4938e8cef9659b7c 2023-02-12 06:02:45,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e5810b3e54afabb05e70eb1e55b617c0 2023-02-12 06:02:45,788 INFO [StoreOpener-9d3a93d53da6320c4938e8cef9659b7c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9d3a93d53da6320c4938e8cef9659b7c 2023-02-12 06:02:45,791 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=12 2023-02-12 06:02:45,791 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=12, state=SUCCESS; OpenRegionProcedure 318c101741f622a7a64c9c89324799b2, server=jenkins-hbase4.apache.org,43903,1676181760972 in 347 msec 2023-02-12 06:02:45,793 DEBUG [StoreOpener-9d3a93d53da6320c4938e8cef9659b7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/f1 2023-02-12 06:02:45,793 DEBUG [StoreOpener-9d3a93d53da6320c4938e8cef9659b7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/f1 2023-02-12 06:02:45,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/e5810b3e54afabb05e70eb1e55b617c0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:02:45,794 INFO [StoreOpener-9d3a93d53da6320c4938e8cef9659b7c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9d3a93d53da6320c4938e8cef9659b7c columnFamilyName f1 2023-02-12 06:02:45,794 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=318c101741f622a7a64c9c89324799b2, ASSIGN in 526 msec 2023-02-12 06:02:45,794 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e5810b3e54afabb05e70eb1e55b617c0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70359579, jitterRate=0.048439428210258484}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:02:45,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e5810b3e54afabb05e70eb1e55b617c0: Running coprocessor pre-open hook at 1676181765765Writing region info on filesystem at 1676181765765Initializing all the Stores at 1676181765766 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181765766Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181765767 (+1 ms)Cleaning up temporary data from old regions at 1676181765780 (+13 ms)Cleaning up detritus from prior splits at 1676181765781 (+1 ms)Running coprocessor post-open hooks at 1676181765794 (+13 ms)Region opened successfully at 1676181765794 2023-02-12 06:02:45,795 INFO [StoreOpener-9d3a93d53da6320c4938e8cef9659b7c-1] regionserver.HStore(310): Store=9d3a93d53da6320c4938e8cef9659b7c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:45,795 INFO [StoreOpener-9d3a93d53da6320c4938e8cef9659b7c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9d3a93d53da6320c4938e8cef9659b7c 2023-02-12 06:02:45,795 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0., pid=26, masterSystemTime=1676181765604 2023-02-12 06:02:45,797 DEBUG [StoreOpener-9d3a93d53da6320c4938e8cef9659b7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/f2 2023-02-12 06:02:45,797 DEBUG [StoreOpener-9d3a93d53da6320c4938e8cef9659b7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/f2 2023-02-12 06:02:45,797 INFO [StoreOpener-9d3a93d53da6320c4938e8cef9659b7c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9d3a93d53da6320c4938e8cef9659b7c columnFamilyName f2 2023-02-12 06:02:45,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0. 2023-02-12 06:02:45,798 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0. 2023-02-12 06:02:45,798 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca. 2023-02-12 06:02:45,798 INFO [StoreOpener-9d3a93d53da6320c4938e8cef9659b7c-1] regionserver.HStore(310): Store=9d3a93d53da6320c4938e8cef9659b7c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:45,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5f4fabd8d4e0ff0b3e3d8eab4c9899ca, NAME => 'testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-12 06:02:45,799 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=e5810b3e54afabb05e70eb1e55b617c0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:45,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 5f4fabd8d4e0ff0b3e3d8eab4c9899ca 2023-02-12 06:02:45,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:45,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5f4fabd8d4e0ff0b3e3d8eab4c9899ca 2023-02-12 06:02:45,799 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676181765799"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676181765799"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676181765799"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676181765799"}]},"ts":"1676181765799"} 2023-02-12 06:02:45,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5f4fabd8d4e0ff0b3e3d8eab4c9899ca 2023-02-12 06:02:45,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c 2023-02-12 06:02:45,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c 2023-02-12 06:02:45,802 INFO [StoreOpener-5f4fabd8d4e0ff0b3e3d8eab4c9899ca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5f4fabd8d4e0ff0b3e3d8eab4c9899ca 2023-02-12 06:02:45,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:02:45,804 DEBUG [StoreOpener-5f4fabd8d4e0ff0b3e3d8eab4c9899ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/f1 2023-02-12 06:02:45,804 DEBUG [StoreOpener-5f4fabd8d4e0ff0b3e3d8eab4c9899ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/f1 2023-02-12 06:02:45,804 INFO [StoreOpener-5f4fabd8d4e0ff0b3e3d8eab4c9899ca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f4fabd8d4e0ff0b3e3d8eab4c9899ca columnFamilyName f1 2023-02-12 06:02:45,805 INFO [StoreOpener-5f4fabd8d4e0ff0b3e3d8eab4c9899ca-1] regionserver.HStore(310): Store=5f4fabd8d4e0ff0b3e3d8eab4c9899ca/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:45,805 INFO [StoreOpener-5f4fabd8d4e0ff0b3e3d8eab4c9899ca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5f4fabd8d4e0ff0b3e3d8eab4c9899ca 2023-02-12 06:02:45,806 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=20 2023-02-12 06:02:45,806 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=20, state=SUCCESS; OpenRegionProcedure e5810b3e54afabb05e70eb1e55b617c0, server=jenkins-hbase4.apache.org,33981,1676181760918 in 355 msec 2023-02-12 06:02:45,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 9d3a93d53da6320c4938e8cef9659b7c 2023-02-12 06:02:45,808 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e5810b3e54afabb05e70eb1e55b617c0, ASSIGN in 540 msec 2023-02-12 06:02:45,809 DEBUG [StoreOpener-5f4fabd8d4e0ff0b3e3d8eab4c9899ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/f2 2023-02-12 06:02:45,809 DEBUG [StoreOpener-5f4fabd8d4e0ff0b3e3d8eab4c9899ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/f2 2023-02-12 06:02:45,809 INFO [StoreOpener-5f4fabd8d4e0ff0b3e3d8eab4c9899ca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f4fabd8d4e0ff0b3e3d8eab4c9899ca columnFamilyName f2 2023-02-12 06:02:45,810 INFO [StoreOpener-5f4fabd8d4e0ff0b3e3d8eab4c9899ca-1] regionserver.HStore(310): Store=5f4fabd8d4e0ff0b3e3d8eab4c9899ca/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:45,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:02:45,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca 2023-02-12 06:02:45,818 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 9d3a93d53da6320c4938e8cef9659b7c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68152983, jitterRate=0.015558585524559021}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:02:45,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 9d3a93d53da6320c4938e8cef9659b7c: Running coprocessor pre-open hook at 1676181765785Writing region info on filesystem at 1676181765785Initializing all the Stores at 1676181765787 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181765787Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181765787Cleaning up temporary data from old regions at 1676181765802 (+15 ms)Cleaning up detritus from prior splits at 1676181765802Running coprocessor post-open hooks at 1676181765818 (+16 ms)Region opened successfully at 1676181765818 2023-02-12 06:02:45,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca 2023-02-12 06:02:45,819 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c., pid=23, masterSystemTime=1676181765589 2023-02-12 06:02:45,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c. 2023-02-12 06:02:45,822 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c. 2023-02-12 06:02:45,823 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=9d3a93d53da6320c4938e8cef9659b7c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:45,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:02:45,823 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181765823"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676181765823"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676181765823"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676181765823"}]},"ts":"1676181765823"} 2023-02-12 06:02:45,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5f4fabd8d4e0ff0b3e3d8eab4c9899ca 2023-02-12 06:02:45,830 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=16 2023-02-12 06:02:45,830 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=16, state=SUCCESS; OpenRegionProcedure 9d3a93d53da6320c4938e8cef9659b7c, server=jenkins-hbase4.apache.org,43903,1676181760972 in 391 msec 2023-02-12 06:02:45,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:02:45,832 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9d3a93d53da6320c4938e8cef9659b7c, ASSIGN in 564 msec 2023-02-12 06:02:45,832 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5f4fabd8d4e0ff0b3e3d8eab4c9899ca; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68706576, jitterRate=0.023807764053344727}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:02:45,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5f4fabd8d4e0ff0b3e3d8eab4c9899ca: Running coprocessor pre-open hook at 1676181765800Writing region info on filesystem at 1676181765800Initializing all the Stores at 1676181765801 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181765801Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181765801Cleaning up temporary data from old regions at 1676181765820 (+19 ms)Cleaning up detritus from prior splits at 1676181765821 (+1 ms)Running coprocessor post-open hooks at 1676181765832 (+11 ms)Region opened successfully at 1676181765832 2023-02-12 06:02:45,833 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca., pid=30, masterSystemTime=1676181765604 2023-02-12 06:02:45,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca. 2023-02-12 06:02:45,836 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca. 2023-02-12 06:02:45,836 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=5f4fabd8d4e0ff0b3e3d8eab4c9899ca, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:45,837 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181765836"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676181765836"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676181765836"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676181765836"}]},"ts":"1676181765836"} 2023-02-12 06:02:45,842 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=18 2023-02-12 06:02:45,842 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=18, state=SUCCESS; OpenRegionProcedure 5f4fabd8d4e0ff0b3e3d8eab4c9899ca, server=jenkins-hbase4.apache.org,33981,1676181760918 in 370 msec 2023-02-12 06:02:45,845 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=18, resume processing ppid=10 2023-02-12 06:02:45,845 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5f4fabd8d4e0ff0b3e3d8eab4c9899ca, ASSIGN in 576 msec 2023-02-12 06:02:45,846 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 06:02:45,846 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676181765846"}]},"ts":"1676181765846"} 2023-02-12 06:02:45,848 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-12 06:02:45,852 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 06:02:45,856 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 929 msec 2023-02-12 06:02:46,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 06:02:46,089 INFO [Listener at localhost/44119] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-12 06:02:46,089 DEBUG [Listener at localhost/44119] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-12 06:02:46,091 INFO [Listener at localhost/44119] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 06:02:46,099 INFO [Listener at localhost/44119] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-12 06:02:46,100 INFO [Listener at localhost/44119] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 06:02:46,100 INFO [Listener at localhost/44119] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-12 06:02:46,100 INFO [Listener at localhost/44119] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-12 06:02:46,239 DEBUG [hconnection-0x43c02d29-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 06:02:46,308 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50480, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 06:02:46,332 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33981] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976. 2023-02-12 06:02:46,333 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43903] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2. 2023-02-12 06:02:46,638 INFO [Listener at localhost/44119] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-12 06:02:46,642 INFO [Listener at localhost/44119] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-12 06:02:46,653 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 06:02:46,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676181766653 (current time:1676181766653). 2023-02-12 06:02:46,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-12 06:02:46,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] zookeeper.ReadOnlyZKClient(139): Connect 0x0fec76cf to 127.0.0.1:56793 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 06:02:46,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@526a0961, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 06:02:46,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 06:02:46,665 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46038, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 06:02:46,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0fec76cf to 127.0.0.1:56793 2023-02-12 06:02:46,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:02:46,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-12 06:02:46,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 06:02:46,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 06:02:46,695 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 06:02:46,696 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676182366696 2023-02-12 06:02:46,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 06:02:46,697 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-12 06:02:46,699 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 06:02:46,700 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 06:02:46,701 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 15 msec 2023-02-12 06:02:46,702 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 06:02:46,703 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676182366703 2023-02-12 06:02:46,703 DEBUG [Listener at localhost/44119] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-12 06:02:46,703 DEBUG [Listener at localhost/44119] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-12 06:02:46,726 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-12 06:02:46,727 INFO [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-12 06:02:46,727 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 06:02:46,727 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-12 06:02:46,727 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-12 06:02:46,728 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 06:02:46,728 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-12 06:02:46,731 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): regionserver:43903-0x100471fcd120002, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 06:02:46,731 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): regionserver:33981-0x100471fcd120001, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 06:02:46,731 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:46,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 06:02:46,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 06:02:46,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:02:46,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:02:46,731 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:46,731 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:46,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-12 06:02:46,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-12 06:02:46,732 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:46,732 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 06:02:46,732 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43903-0x100471fcd120002, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 06:02:46,732 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33981-0x100471fcd120001, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 06:02:46,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-12 06:02:46,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-12 06:02:46,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-12 06:02:46,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-12 06:02:46,733 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-12 06:02:46,733 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-12 06:02:46,736 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-12 06:02:46,736 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-12 06:02:46,736 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-12 06:02:46,736 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-12 06:02:46,736 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 06:02:46,736 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 06:02:46,737 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-12 06:02:46,737 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-12 06:02:46,737 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-12 06:02:46,737 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-12 06:02:46,737 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33981,1676181760918' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-12 06:02:46,737 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43903,1676181760972' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-12 06:02:46,739 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:46,739 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 06:02:46,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:46,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:02:46,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 06:02:46,740 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 06:02:46,740 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33981-0x100471fcd120001, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 06:02:46,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:02:46,740 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 06:02:46,740 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:46,740 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43903-0x100471fcd120002, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 06:02:46,740 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 06:02:46,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:02:46,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 06:02:46,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:46,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:46,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:02:46,742 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33981,1676181760918' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-12 06:02:46,742 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@771f8700[Count = 1] remaining members to acquire global barrier 2023-02-12 06:02:46,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:46,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:02:46,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 06:02:46,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:02:46,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:02:46,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 06:02:46,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:46,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:46,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:02:46,745 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43903,1676181760972' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-12 06:02:46,745 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@771f8700[Count = 0] remaining members to acquire global barrier 2023-02-12 06:02:46,745 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-12 06:02:46,745 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 06:02:46,747 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): regionserver:33981-0x100471fcd120001, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 06:02:46,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 06:02:46,747 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): regionserver:43903-0x100471fcd120002, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 06:02:46,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 06:02:46,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 06:02:46,747 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-12 06:02:46,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 06:02:46,747 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:46,747 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-12 06:02:46,748 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:46,748 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 06:02:46,748 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca. 2023-02-12 06:02:46,748 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592. 2023-02-12 06:02:46,748 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676181764917.a628981a708add40d0832641d94930a1. 2023-02-12 06:02:46,749 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f. 2023-02-12 06:02:46,749 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676181764917.a628981a708add40d0832641d94930a1. started... 2023-02-12 06:02:46,749 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-12 06:02:46,749 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0. 2023-02-12 06:02:46,749 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f. started... 2023-02-12 06:02:46,749 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca. started... 2023-02-12 06:02:46,749 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592. started... 2023-02-12 06:02:46,749 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0. started... 2023-02-12 06:02:46,749 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 06:02:46,752 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-12 06:02:46,752 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 06:02:46,752 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-0] regionserver.HRegion(2744): Flushing ce3f693b6332926321d72525ad1f0592 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-12 06:02:46,752 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-1] regionserver.HRegion(2744): Flushing a628981a708add40d0832641d94930a1 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 06:02:46,752 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 5f4fabd8d4e0ff0b3e3d8eab4c9899ca 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 06:02:46,752 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c. 2023-02-12 06:02:46,753 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c. started... 2023-02-12 06:02:46,753 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 9d3a93d53da6320c4938e8cef9659b7c 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 06:02:46,754 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 8179ea2f8e67c4dfba2d173b7540832f: 2023-02-12 06:02:46,754 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for e5810b3e54afabb05e70eb1e55b617c0: 2023-02-12 06:02:46,755 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 06:02:46,755 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 06:02:46,760 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 06:02:46,760 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 06:02:46,765 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 06:02:46,765 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 06:02:46,766 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 06:02:46,766 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 06:02:46,803 DEBUG [Listener at localhost/44119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 06:02:46,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 06:02:46,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 06:02:46,813 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0. completed. 2023-02-12 06:02:46,813 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0. 2023-02-12 06:02:46,814 DEBUG [Listener at localhost/44119] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-12 06:02:46,814 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-12 06:02:46,814 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976. 2023-02-12 06:02:46,814 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976. started... 2023-02-12 06:02:46,815 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-2] regionserver.HRegion(2744): Flushing a108e70c13825ee3f5ff04e1a1a26976 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 06:02:46,940 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/.tmp/f1/496d2656ee684894a3923bbb24127753 2023-02-12 06:02:46,976 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/.tmp/f1/22b6342600244813bdd116a47900b8b8 2023-02-12 06:02:46,979 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/.tmp/f1/d2c10c710bb74381a077db4f5a8aa70e 2023-02-12 06:02:46,984 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/.tmp/f1/959b2c5834634c4db9efe3ec6c427418 2023-02-12 06:02:47,014 DEBUG [Listener at localhost/44119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 06:02:47,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 06:02:47,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 06:02:47,017 DEBUG [Listener at localhost/44119] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-12 06:02:47,091 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/.tmp/f2/36901009def44729b60b0ed26d7c9c5e 2023-02-12 06:02:47,103 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/.tmp/f1/959b2c5834634c4db9efe3ec6c427418 as hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/f1/959b2c5834634c4db9efe3ec6c427418 2023-02-12 06:02:47,125 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/.tmp/f2/9799e4fd82874858a03798f705647159 2023-02-12 06:02:47,126 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/.tmp/f2/ff08c997325a403e90c32b594b2bf7bf 2023-02-12 06:02:47,128 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/f1/959b2c5834634c4db9efe3ec6c427418, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 06:02:47,131 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/.tmp/f2/0afb16a97b384baa986ce2acfbf7a883 2023-02-12 06:02:47,132 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/.tmp/f2/36901009def44729b60b0ed26d7c9c5e as hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/f2/36901009def44729b60b0ed26d7c9c5e 2023-02-12 06:02:47,142 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/.tmp/f1/d2c10c710bb74381a077db4f5a8aa70e as hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/f1/d2c10c710bb74381a077db4f5a8aa70e 2023-02-12 06:02:47,142 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/.tmp/f1/496d2656ee684894a3923bbb24127753 as hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/f1/496d2656ee684894a3923bbb24127753 2023-02-12 06:02:47,145 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/.tmp/f1/22b6342600244813bdd116a47900b8b8 as hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/f1/22b6342600244813bdd116a47900b8b8 2023-02-12 06:02:47,146 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/f2/36901009def44729b60b0ed26d7c9c5e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 06:02:47,148 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for a628981a708add40d0832641d94930a1 in 396ms, sequenceid=5, compaction requested=false 2023-02-12 06:02:47,151 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-12 06:02:47,153 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for a628981a708add40d0832641d94930a1: 2023-02-12 06:02:47,153 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676181764917.a628981a708add40d0832641d94930a1.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 06:02:47,154 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 06:02:47,154 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/f1/959b2c5834634c4db9efe3ec6c427418] hfiles 2023-02-12 06:02:47,154 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/f1/959b2c5834634c4db9efe3ec6c427418 for snapshot=testWithMapReduceMultiRegion 2023-02-12 06:02:47,156 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/f1/22b6342600244813bdd116a47900b8b8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 06:02:47,158 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/.tmp/f2/0afb16a97b384baa986ce2acfbf7a883 as hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/f2/0afb16a97b384baa986ce2acfbf7a883 2023-02-12 06:02:47,159 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/f1/496d2656ee684894a3923bbb24127753, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 06:02:47,160 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/f1/d2c10c710bb74381a077db4f5a8aa70e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 06:02:47,160 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/f2/36901009def44729b60b0ed26d7c9c5e] hfiles 2023-02-12 06:02:47,160 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/f2/36901009def44729b60b0ed26d7c9c5e for snapshot=testWithMapReduceMultiRegion 2023-02-12 06:02:47,161 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/.tmp/f2/ff08c997325a403e90c32b594b2bf7bf as hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/f2/ff08c997325a403e90c32b594b2bf7bf 2023-02-12 06:02:47,161 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/.tmp/f2/9799e4fd82874858a03798f705647159 as hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/f2/9799e4fd82874858a03798f705647159 2023-02-12 06:02:47,170 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/f2/0afb16a97b384baa986ce2acfbf7a883, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 06:02:47,172 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 9d3a93d53da6320c4938e8cef9659b7c in 419ms, sequenceid=5, compaction requested=false 2023-02-12 06:02:47,172 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/f2/ff08c997325a403e90c32b594b2bf7bf, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 06:02:47,173 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for ce3f693b6332926321d72525ad1f0592 in 421ms, sequenceid=5, compaction requested=false 2023-02-12 06:02:47,177 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 9d3a93d53da6320c4938e8cef9659b7c: 2023-02-12 06:02:47,177 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for ce3f693b6332926321d72525ad1f0592: 2023-02-12 06:02:47,177 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 06:02:47,177 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 06:02:47,177 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 06:02:47,177 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 06:02:47,177 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/f1/22b6342600244813bdd116a47900b8b8] hfiles 2023-02-12 06:02:47,177 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/f1/496d2656ee684894a3923bbb24127753] hfiles 2023-02-12 06:02:47,177 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/f1/22b6342600244813bdd116a47900b8b8 for snapshot=testWithMapReduceMultiRegion 2023-02-12 06:02:47,177 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/f1/496d2656ee684894a3923bbb24127753 for snapshot=testWithMapReduceMultiRegion 2023-02-12 06:02:47,177 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/f2/0afb16a97b384baa986ce2acfbf7a883] hfiles 2023-02-12 06:02:47,177 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/f2/ff08c997325a403e90c32b594b2bf7bf] hfiles 2023-02-12 06:02:47,178 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/f2/ff08c997325a403e90c32b594b2bf7bf for snapshot=testWithMapReduceMultiRegion 2023-02-12 06:02:47,178 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/f2/0afb16a97b384baa986ce2acfbf7a883 for snapshot=testWithMapReduceMultiRegion 2023-02-12 06:02:47,180 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/f2/9799e4fd82874858a03798f705647159, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 06:02:47,181 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for a108e70c13825ee3f5ff04e1a1a26976 in 366ms, sequenceid=5, compaction requested=false 2023-02-12 06:02:47,182 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for a108e70c13825ee3f5ff04e1a1a26976: 2023-02-12 06:02:47,182 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 06:02:47,182 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 06:02:47,182 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/f1/d2c10c710bb74381a077db4f5a8aa70e] hfiles 2023-02-12 06:02:47,182 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/f1/d2c10c710bb74381a077db4f5a8aa70e for snapshot=testWithMapReduceMultiRegion 2023-02-12 06:02:47,182 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/f2/9799e4fd82874858a03798f705647159] hfiles 2023-02-12 06:02:47,182 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/f2/9799e4fd82874858a03798f705647159 for snapshot=testWithMapReduceMultiRegion 2023-02-12 06:02:47,196 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676181764917.a628981a708add40d0832641d94930a1. completed. 2023-02-12 06:02:47,196 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676181764917.a628981a708add40d0832641d94930a1. 2023-02-12 06:02:47,196 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d. 2023-02-12 06:02:47,196 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-12 06:02:47,196 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d. started... 2023-02-12 06:02:47,202 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-1] regionserver.HRegion(2744): Flushing ede1a2ead4c611c9c8e6e77d11191a1d 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 06:02:47,217 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f. completed. 2023-02-12 06:02:47,217 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f. 2023-02-12 06:02:47,220 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e. 2023-02-12 06:02:47,220 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-12 06:02:47,220 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e. started... 2023-02-12 06:02:47,221 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c. completed. 2023-02-12 06:02:47,221 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c. 2023-02-12 06:02:47,221 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2. 2023-02-12 06:02:47,221 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-12 06:02:47,221 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2. started... 2023-02-12 06:02:47,224 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 318c101741f622a7a64c9c89324799b2 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-12 06:02:47,224 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 305521ef65605b0ecbb78cb79cda5d7e 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 06:02:47,227 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592. completed. 2023-02-12 06:02:47,227 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592. 2023-02-12 06:02:47,227 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-12 06:02:47,230 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976. completed. 2023-02-12 06:02:47,232 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976. 2023-02-12 06:02:47,232 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-12 06:02:47,253 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/.tmp/f1/c1e8de00e2d242c588e62e77ab8d267b 2023-02-12 06:02:47,277 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/.tmp/f1/04db54a59dd947d69d87f408df68b233 2023-02-12 06:02:47,294 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/.tmp/f1/5bbfd03016ad40e9a47aa343963a9932 2023-02-12 06:02:47,305 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/.tmp/f2/04019d7c88ba4a3f96feee1fa33432e5 2023-02-12 06:02:47,312 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/.tmp/f1/c1e8de00e2d242c588e62e77ab8d267b as hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/f1/c1e8de00e2d242c588e62e77ab8d267b 2023-02-12 06:02:47,317 DEBUG [Listener at localhost/44119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 06:02:47,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 06:02:47,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 06:02:47,320 DEBUG [Listener at localhost/44119] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-12 06:02:47,324 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/f1/c1e8de00e2d242c588e62e77ab8d267b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 06:02:47,325 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/.tmp/f2/04019d7c88ba4a3f96feee1fa33432e5 as hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/f2/04019d7c88ba4a3f96feee1fa33432e5 2023-02-12 06:02:47,332 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/.tmp/f2/082b13d4196f4b51bcefd14687a1f46d 2023-02-12 06:02:47,337 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/f2/04019d7c88ba4a3f96feee1fa33432e5, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 06:02:47,338 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for ede1a2ead4c611c9c8e6e77d11191a1d in 136ms, sequenceid=5, compaction requested=false 2023-02-12 06:02:47,338 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for ede1a2ead4c611c9c8e6e77d11191a1d: 2023-02-12 06:02:47,339 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 06:02:47,339 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 06:02:47,339 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/f1/c1e8de00e2d242c588e62e77ab8d267b] hfiles 2023-02-12 06:02:47,339 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/f1/c1e8de00e2d242c588e62e77ab8d267b for snapshot=testWithMapReduceMultiRegion 2023-02-12 06:02:47,339 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/f2/04019d7c88ba4a3f96feee1fa33432e5] hfiles 2023-02-12 06:02:47,339 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/f2/04019d7c88ba4a3f96feee1fa33432e5 for snapshot=testWithMapReduceMultiRegion 2023-02-12 06:02:47,342 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/.tmp/f1/04db54a59dd947d69d87f408df68b233 as hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/f1/04db54a59dd947d69d87f408df68b233 2023-02-12 06:02:47,348 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/f1/04db54a59dd947d69d87f408df68b233, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 06:02:47,350 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/.tmp/f2/082b13d4196f4b51bcefd14687a1f46d as hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/f2/082b13d4196f4b51bcefd14687a1f46d 2023-02-12 06:02:47,356 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/f2/082b13d4196f4b51bcefd14687a1f46d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 06:02:47,358 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 305521ef65605b0ecbb78cb79cda5d7e in 134ms, sequenceid=5, compaction requested=false 2023-02-12 06:02:47,358 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 305521ef65605b0ecbb78cb79cda5d7e: 2023-02-12 06:02:47,358 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 06:02:47,358 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 06:02:47,358 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/f1/04db54a59dd947d69d87f408df68b233] hfiles 2023-02-12 06:02:47,358 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/f1/04db54a59dd947d69d87f408df68b233 for snapshot=testWithMapReduceMultiRegion 2023-02-12 06:02:47,358 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/f2/082b13d4196f4b51bcefd14687a1f46d] hfiles 2023-02-12 06:02:47,358 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/f2/082b13d4196f4b51bcefd14687a1f46d for snapshot=testWithMapReduceMultiRegion 2023-02-12 06:02:47,368 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d. completed. 2023-02-12 06:02:47,368 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d. 2023-02-12 06:02:47,368 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-12 06:02:47,379 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e. completed. 2023-02-12 06:02:47,379 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e. 2023-02-12 06:02:47,379 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-12 06:02:47,386 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/.tmp/f1/5e373fe3670d4f07bbc4fbcd94739b17 2023-02-12 06:02:47,411 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/.tmp/f2/c7c991ed20e142b7b9c25fa14ef8e8c1 2023-02-12 06:02:47,421 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/.tmp/f1/5e373fe3670d4f07bbc4fbcd94739b17 as hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/f1/5e373fe3670d4f07bbc4fbcd94739b17 2023-02-12 06:02:47,428 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/f1/5e373fe3670d4f07bbc4fbcd94739b17, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 06:02:47,429 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/.tmp/f2/c7c991ed20e142b7b9c25fa14ef8e8c1 as hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/f2/c7c991ed20e142b7b9c25fa14ef8e8c1 2023-02-12 06:02:47,436 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/f2/c7c991ed20e142b7b9c25fa14ef8e8c1, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 06:02:47,437 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 5f4fabd8d4e0ff0b3e3d8eab4c9899ca in 685ms, sequenceid=5, compaction requested=false 2023-02-12 06:02:47,438 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 5f4fabd8d4e0ff0b3e3d8eab4c9899ca: 2023-02-12 06:02:47,438 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 06:02:47,438 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 06:02:47,438 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/f1/5e373fe3670d4f07bbc4fbcd94739b17] hfiles 2023-02-12 06:02:47,438 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/f1/5e373fe3670d4f07bbc4fbcd94739b17 for snapshot=testWithMapReduceMultiRegion 2023-02-12 06:02:47,438 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/f2/c7c991ed20e142b7b9c25fa14ef8e8c1] hfiles 2023-02-12 06:02:47,438 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/f2/c7c991ed20e142b7b9c25fa14ef8e8c1 for snapshot=testWithMapReduceMultiRegion 2023-02-12 06:02:47,446 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca. completed. 2023-02-12 06:02:47,446 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca. 2023-02-12 06:02:47,446 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-12 06:02:47,446 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-12 06:02:47,446 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:47,446 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-12 06:02:47,446 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,33981,1676181760918' in zk 2023-02-12 06:02:47,451 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:47,451 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-12 06:02:47,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:47,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:02:47,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 06:02:47,452 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:02:47,452 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-12 06:02:47,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:02:47,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:02:47,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 06:02:47,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:47,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:47,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:02:47,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 06:02:47,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:47,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,33981,1676181760918': 2023-02-12 06:02:47,456 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33981,1676181760918' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-12 06:02:47,732 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/.tmp/f2/ec3b46a9acd74245b3888084b2815d64 2023-02-12 06:02:47,740 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/.tmp/f1/5bbfd03016ad40e9a47aa343963a9932 as hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/f1/5bbfd03016ad40e9a47aa343963a9932 2023-02-12 06:02:47,747 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/f1/5bbfd03016ad40e9a47aa343963a9932, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 06:02:47,748 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/.tmp/f2/ec3b46a9acd74245b3888084b2815d64 as hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/f2/ec3b46a9acd74245b3888084b2815d64 2023-02-12 06:02:47,755 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/f2/ec3b46a9acd74245b3888084b2815d64, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 06:02:47,756 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 318c101741f622a7a64c9c89324799b2 in 532ms, sequenceid=5, compaction requested=false 2023-02-12 06:02:47,756 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 318c101741f622a7a64c9c89324799b2: 2023-02-12 06:02:47,757 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-12 06:02:47,757 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 06:02:47,757 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/f1/5bbfd03016ad40e9a47aa343963a9932] hfiles 2023-02-12 06:02:47,757 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/f1/5bbfd03016ad40e9a47aa343963a9932 for snapshot=testWithMapReduceMultiRegion 2023-02-12 06:02:47,757 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/f2/ec3b46a9acd74245b3888084b2815d64] hfiles 2023-02-12 06:02:47,757 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/f2/ec3b46a9acd74245b3888084b2815d64 for snapshot=testWithMapReduceMultiRegion 2023-02-12 06:02:47,778 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2. completed. 2023-02-12 06:02:47,778 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2. 2023-02-12 06:02:47,778 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-12 06:02:47,778 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-12 06:02:47,778 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:47,778 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-12 06:02:47,778 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,43903,1676181760972' in zk 2023-02-12 06:02:47,781 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:47,781 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-12 06:02:47,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:47,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:02:47,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 06:02:47,781 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:02:47,781 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-12 06:02:47,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:02:47,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:02:47,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 06:02:47,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:47,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:47,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:02:47,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 06:02:47,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:47,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:47,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,43903,1676181760972': 2023-02-12 06:02:47,786 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43903,1676181760972' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-12 06:02:47,786 INFO [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-12 06:02:47,786 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 06:02:47,786 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 06:02:47,786 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-12 06:02:47,786 INFO [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-12 06:02:47,789 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): regionserver:43903-0x100471fcd120002, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 06:02:47,789 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 06:02:47,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 06:02:47,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 06:02:47,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 06:02:47,789 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): regionserver:43903-0x100471fcd120002, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 06:02:47,789 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): regionserver:33981-0x100471fcd120001, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 06:02:47,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:02:47,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 06:02:47,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 06:02:47,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 06:02:47,789 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): regionserver:33981-0x100471fcd120001, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 06:02:47,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 06:02:47,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:02:47,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:02:47,790 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:47,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 06:02:47,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:02:47,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 06:02:47,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 06:02:47,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 06:02:47,791 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:47,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:02:47,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 06:02:47,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:47,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:47,793 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:47,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:02:47,794 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:47,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-12 06:02:47,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:47,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:47,807 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:47,807 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-12 06:02:47,807 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): regionserver:33981-0x100471fcd120001, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 06:02:47,807 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): regionserver:43903-0x100471fcd120002, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 06:02:47,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 06:02:47,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 06:02:47,807 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-12 06:02:47,807 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): regionserver:43903-0x100471fcd120002, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 06:02:47,807 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:02:47,808 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-12 06:02:47,807 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): regionserver:33981-0x100471fcd120001, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 06:02:47,807 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:47,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:02:47,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:02:47,808 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-12 06:02:47,809 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:47,809 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 06:02:47,809 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:47,809 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-12 06:02:47,809 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-12 06:02:47,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 06:02:47,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:02:47,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 06:02:47,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:02:47,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-12 06:02:47,820 DEBUG [Listener at localhost/44119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 06:02:47,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 06:02:47,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 06:02:47,822 DEBUG [Listener at localhost/44119] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-12 06:02:47,881 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-12 06:02:47,911 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-12 06:02:47,912 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-12 06:02:47,912 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-12 06:02:47,912 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676181766697Consolidate snapshot: testWithMapReduceMultiRegion at 1676181767808 (+1111 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1676181767808Writing data manifest for testWithMapReduceMultiRegion at 1676181767841 (+33 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1676181767857 (+16 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1676181767911 (+54 ms) 2023-02-12 06:02:47,913 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 06:02:47,916 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.2150 sec 2023-02-12 06:02:48,823 DEBUG [Listener at localhost/44119] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 06:02:48,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 06:02:48,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-12 06:02:48,828 INFO [Listener at localhost/44119] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-12 06:02:48,857 INFO [Listener at localhost/44119] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-12 06:02:48,870 INFO [Listener at localhost/44119] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-12 06:02:48,945 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33981] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976. 2023-02-12 06:02:48,950 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43903] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2. 2023-02-12 06:02:49,082 INFO [Listener at localhost/44119] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-12 06:02:49,098 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-12 06:02:49,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-12 06:02:49,103 INFO [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-12 06:02:49,103 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 06:02:49,103 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-12 06:02:49,104 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-12 06:02:49,104 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:02:49,104 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 06:02:49,106 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): regionserver:43903-0x100471fcd120002, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 06:02:49,106 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:49,106 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): regionserver:33981-0x100471fcd120001, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 06:02:49,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 06:02:49,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 06:02:49,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:02:49,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:02:49,106 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:49,106 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:49,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 06:02:49,107 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:49,107 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 06:02:49,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 06:02:49,107 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33981-0x100471fcd120001, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:02:49,107 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43903-0x100471fcd120002, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:02:49,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 06:02:49,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 06:02:49,108 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-12 06:02:49,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 06:02:49,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 06:02:49,108 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-12 06:02:49,109 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-12 06:02:49,109 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-12 06:02:49,109 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-12 06:02:49,110 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 06:02:49,109 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-12 06:02:49,110 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-12 06:02:49,110 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 06:02:49,111 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-12 06:02:49,112 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592. 2023-02-12 06:02:49,112 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592. started... 2023-02-12 06:02:49,112 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca. 2023-02-12 06:02:49,112 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ce3f693b6332926321d72525ad1f0592 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-12 06:02:49,112 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca. started... 2023-02-12 06:02:49,112 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5f4fabd8d4e0ff0b3e3d8eab4c9899ca 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 06:02:49,116 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f. 2023-02-12 06:02:49,116 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676181764917.a628981a708add40d0832641d94930a1. 2023-02-12 06:02:49,116 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f. started... 2023-02-12 06:02:49,117 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676181764917.a628981a708add40d0832641d94930a1. started... 2023-02-12 06:02:49,117 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 8179ea2f8e67c4dfba2d173b7540832f: 2023-02-12 06:02:49,117 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f. 2023-02-12 06:02:49,117 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing a628981a708add40d0832641d94930a1 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 06:02:49,121 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e. 2023-02-12 06:02:49,121 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c. 2023-02-12 06:02:49,121 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e. started... 2023-02-12 06:02:49,122 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0. 2023-02-12 06:02:49,122 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0. started... 2023-02-12 06:02:49,121 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-12 06:02:49,122 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for e5810b3e54afabb05e70eb1e55b617c0: 2023-02-12 06:02:49,122 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 305521ef65605b0ecbb78cb79cda5d7e 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 06:02:49,122 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0. 2023-02-12 06:02:49,122 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976. 2023-02-12 06:02:49,122 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976. started... 2023-02-12 06:02:49,122 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing a108e70c13825ee3f5ff04e1a1a26976 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 06:02:49,121 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-12 06:02:49,122 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 06:02:49,121 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c. started... 2023-02-12 06:02:49,122 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-12 06:02:49,123 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 9d3a93d53da6320c4938e8cef9659b7c 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 06:02:49,122 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 06:02:49,124 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-12 06:02:49,194 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/.tmp/f1/10c52d63b5c84360a2eb7c9ed8a036bf 2023-02-12 06:02:49,209 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/.tmp/f1/b350aed70b8f4ccfb5050d009d1773b0 2023-02-12 06:02:49,210 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/.tmp/f1/726526fb49e3429ab59ab8a28c8f34f9 2023-02-12 06:02:49,211 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/.tmp/f1/aeaa0bf9609149ed89911f7647bf4f58 2023-02-12 06:02:49,213 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/.tmp/f1/690e533ffd2f4c72abc6eddf9f12a2c3 2023-02-12 06:02:49,217 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/.tmp/f1/54ecab56e628413c8b216dcc356867ca 2023-02-12 06:02:49,268 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/.tmp/f2/f41cff29818f4a8b89e99b00923829cf 2023-02-12 06:02:49,281 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/.tmp/f1/b350aed70b8f4ccfb5050d009d1773b0 as hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/f1/b350aed70b8f4ccfb5050d009d1773b0 2023-02-12 06:02:49,284 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/.tmp/f2/921aedb34001438ba763c82be3f36abb 2023-02-12 06:02:49,284 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/.tmp/f2/83788949b6254215ba0dfc3c1e64401e 2023-02-12 06:02:49,290 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/f1/b350aed70b8f4ccfb5050d009d1773b0, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 06:02:49,292 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/.tmp/f2/f41cff29818f4a8b89e99b00923829cf as hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/f2/f41cff29818f4a8b89e99b00923829cf 2023-02-12 06:02:49,293 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/.tmp/f2/7b2505fc33164624aca97310355e9c2b 2023-02-12 06:02:49,297 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/.tmp/f1/690e533ffd2f4c72abc6eddf9f12a2c3 as hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/f1/690e533ffd2f4c72abc6eddf9f12a2c3 2023-02-12 06:02:49,301 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/f2/f41cff29818f4a8b89e99b00923829cf, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 06:02:49,301 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/.tmp/f1/726526fb49e3429ab59ab8a28c8f34f9 as hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/f1/726526fb49e3429ab59ab8a28c8f34f9 2023-02-12 06:02:49,302 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for a628981a708add40d0832641d94930a1 in 185ms, sequenceid=9, compaction requested=false 2023-02-12 06:02:49,302 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for a628981a708add40d0832641d94930a1: 2023-02-12 06:02:49,302 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676181764917.a628981a708add40d0832641d94930a1. 2023-02-12 06:02:49,302 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d. 2023-02-12 06:02:49,302 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-12 06:02:49,303 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d. started... 2023-02-12 06:02:49,303 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing ede1a2ead4c611c9c8e6e77d11191a1d 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 06:02:49,304 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/.tmp/f1/54ecab56e628413c8b216dcc356867ca as hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/f1/54ecab56e628413c8b216dcc356867ca 2023-02-12 06:02:49,306 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/f1/690e533ffd2f4c72abc6eddf9f12a2c3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 06:02:49,307 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/.tmp/f2/83788949b6254215ba0dfc3c1e64401e as hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/f2/83788949b6254215ba0dfc3c1e64401e 2023-02-12 06:02:49,338 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/f1/54ecab56e628413c8b216dcc356867ca, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 06:02:49,340 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/.tmp/f2/921aedb34001438ba763c82be3f36abb as hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/f2/921aedb34001438ba763c82be3f36abb 2023-02-12 06:02:49,342 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/f2/83788949b6254215ba0dfc3c1e64401e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 06:02:49,343 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 9d3a93d53da6320c4938e8cef9659b7c in 221ms, sequenceid=9, compaction requested=false 2023-02-12 06:02:49,343 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 9d3a93d53da6320c4938e8cef9659b7c: 2023-02-12 06:02:49,343 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c. 2023-02-12 06:02:49,343 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2. 2023-02-12 06:02:49,343 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-12 06:02:49,343 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2. started... 2023-02-12 06:02:49,344 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 318c101741f622a7a64c9c89324799b2 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-12 06:02:49,344 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/f1/726526fb49e3429ab59ab8a28c8f34f9, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 06:02:49,345 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/.tmp/f2/7b2505fc33164624aca97310355e9c2b as hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/f2/7b2505fc33164624aca97310355e9c2b 2023-02-12 06:02:49,350 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/f2/921aedb34001438ba763c82be3f36abb, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 06:02:49,352 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for a108e70c13825ee3f5ff04e1a1a26976 in 230ms, sequenceid=9, compaction requested=false 2023-02-12 06:02:49,352 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for a108e70c13825ee3f5ff04e1a1a26976: 2023-02-12 06:02:49,352 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976. 2023-02-12 06:02:49,352 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-12 06:02:49,354 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-12 06:02:49,358 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/f2/7b2505fc33164624aca97310355e9c2b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 06:02:49,359 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 305521ef65605b0ecbb78cb79cda5d7e in 238ms, sequenceid=9, compaction requested=false 2023-02-12 06:02:49,359 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 305521ef65605b0ecbb78cb79cda5d7e: 2023-02-12 06:02:49,359 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e. 2023-02-12 06:02:49,359 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-12 06:02:49,363 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/.tmp/f1/afd7b2567a614cf09677de928978d96f 2023-02-12 06:02:49,368 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/.tmp/f1/a8f2912ca4ab44a09549a0262d4657ac 2023-02-12 06:02:49,387 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/.tmp/f2/ace8c1b602bd49ec82074e8239030b38 2023-02-12 06:02:49,389 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/.tmp/f2/656dd20d583e4baea788f9aa6ac83e69 2023-02-12 06:02:49,397 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/.tmp/f1/afd7b2567a614cf09677de928978d96f as hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/f1/afd7b2567a614cf09677de928978d96f 2023-02-12 06:02:49,398 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/.tmp/f1/a8f2912ca4ab44a09549a0262d4657ac as hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/f1/a8f2912ca4ab44a09549a0262d4657ac 2023-02-12 06:02:49,403 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/f1/afd7b2567a614cf09677de928978d96f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 06:02:49,404 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/.tmp/f2/ace8c1b602bd49ec82074e8239030b38 as hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/f2/ace8c1b602bd49ec82074e8239030b38 2023-02-12 06:02:49,405 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/f1/a8f2912ca4ab44a09549a0262d4657ac, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 06:02:49,406 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/.tmp/f2/656dd20d583e4baea788f9aa6ac83e69 as hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/f2/656dd20d583e4baea788f9aa6ac83e69 2023-02-12 06:02:49,411 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/f2/ace8c1b602bd49ec82074e8239030b38, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 06:02:49,412 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for ede1a2ead4c611c9c8e6e77d11191a1d in 109ms, sequenceid=9, compaction requested=false 2023-02-12 06:02:49,412 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for ede1a2ead4c611c9c8e6e77d11191a1d: 2023-02-12 06:02:49,413 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d. 2023-02-12 06:02:49,413 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-12 06:02:49,413 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/f2/656dd20d583e4baea788f9aa6ac83e69, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 06:02:49,414 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 318c101741f622a7a64c9c89324799b2 in 70ms, sequenceid=9, compaction requested=false 2023-02-12 06:02:49,415 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 318c101741f622a7a64c9c89324799b2: 2023-02-12 06:02:49,415 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2. 2023-02-12 06:02:49,415 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-12 06:02:49,428 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-12 06:02:49,430 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-12 06:02:49,653 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/.tmp/f2/308b8b70976f47239b04565976d2edf6 2023-02-12 06:02:49,660 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/.tmp/f1/10c52d63b5c84360a2eb7c9ed8a036bf as hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/f1/10c52d63b5c84360a2eb7c9ed8a036bf 2023-02-12 06:02:49,666 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/f1/10c52d63b5c84360a2eb7c9ed8a036bf, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 06:02:49,667 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/.tmp/f2/308b8b70976f47239b04565976d2edf6 as hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/f2/308b8b70976f47239b04565976d2edf6 2023-02-12 06:02:49,673 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/f2/308b8b70976f47239b04565976d2edf6, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 06:02:49,673 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/.tmp/f2/237ca5f2b636422da283e230b5e9d3de 2023-02-12 06:02:49,674 INFO [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 5f4fabd8d4e0ff0b3e3d8eab4c9899ca in 562ms, sequenceid=9, compaction requested=false 2023-02-12 06:02:49,674 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5f4fabd8d4e0ff0b3e3d8eab4c9899ca: 2023-02-12 06:02:49,674 DEBUG [rs(jenkins-hbase4.apache.org,33981,1676181760918)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca. 2023-02-12 06:02:49,674 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-12 06:02:49,674 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-12 06:02:49,674 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:49,674 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-12 06:02:49,674 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33981,1676181760918' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-12 06:02:49,677 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:49,677 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 06:02:49,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:49,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:02:49,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 06:02:49,677 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33981-0x100471fcd120001, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 06:02:49,677 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 06:02:49,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:02:49,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:02:49,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 06:02:49,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:49,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:02:49,679 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33981,1676181760918' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-12 06:02:49,679 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1575211b[Count = 1] remaining members to acquire global barrier 2023-02-12 06:02:49,680 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/.tmp/f1/aeaa0bf9609149ed89911f7647bf4f58 as hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/f1/aeaa0bf9609149ed89911f7647bf4f58 2023-02-12 06:02:49,685 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/f1/aeaa0bf9609149ed89911f7647bf4f58, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 06:02:49,686 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/.tmp/f2/237ca5f2b636422da283e230b5e9d3de as hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/f2/237ca5f2b636422da283e230b5e9d3de 2023-02-12 06:02:49,692 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/f2/237ca5f2b636422da283e230b5e9d3de, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 06:02:49,693 INFO [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for ce3f693b6332926321d72525ad1f0592 in 581ms, sequenceid=9, compaction requested=false 2023-02-12 06:02:49,693 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ce3f693b6332926321d72525ad1f0592: 2023-02-12 06:02:49,693 DEBUG [rs(jenkins-hbase4.apache.org,43903,1676181760972)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592. 2023-02-12 06:02:49,693 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-12 06:02:49,693 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-12 06:02:49,693 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:49,693 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-12 06:02:49,693 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43903,1676181760972' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-12 06:02:49,695 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:49,695 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 06:02:49,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:49,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:02:49,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 06:02:49,695 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43903-0x100471fcd120002, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 06:02:49,695 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 06:02:49,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:02:49,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:02:49,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 06:02:49,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:49,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:49,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:02:49,705 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43903,1676181760972' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-12 06:02:49,705 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1575211b[Count = 0] remaining members to acquire global barrier 2023-02-12 06:02:49,705 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-12 06:02:49,705 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 06:02:49,708 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): regionserver:33981-0x100471fcd120001, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 06:02:49,708 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): regionserver:43903-0x100471fcd120002, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 06:02:49,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 06:02:49,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 06:02:49,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 06:02:49,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 06:02:49,709 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-12 06:02:49,709 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:49,709 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-12 06:02:49,709 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-12 06:02:49,709 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,33981,1676181760918' in zk 2023-02-12 06:02:49,709 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-12 06:02:49,709 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,43903,1676181760972' in zk 2023-02-12 06:02:49,709 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:49,709 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 06:02:49,711 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-12 06:02:49,711 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:49,711 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:02:49,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:49,711 DEBUG [member: 'jenkins-hbase4.apache.org,33981,1676181760918' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-12 06:02:49,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:02:49,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 06:02:49,712 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:49,712 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-12 06:02:49,712 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:02:49,712 DEBUG [member: 'jenkins-hbase4.apache.org,43903,1676181760972' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-12 06:02:49,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:02:49,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:02:49,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 06:02:49,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:49,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:49,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:02:49,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 06:02:49,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:49,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:49,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,33981,1676181760918': 2023-02-12 06:02:49,716 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33981,1676181760918' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-12 06:02:49,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:49,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:02:49,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 06:02:49,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:02:49,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:02:49,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 06:02:49,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:49,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:49,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:02:49,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 06:02:49,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:49,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:49,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,43903,1676181760972': 2023-02-12 06:02:49,720 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43903,1676181760972' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-12 06:02:49,720 INFO [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-12 06:02:49,720 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 06:02:49,720 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 06:02:49,720 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-12 06:02:49,720 INFO [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 06:02:49,722 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): regionserver:43903-0x100471fcd120002, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:02:49,722 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:02:49,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:02:49,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:02:49,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:02:49,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 06:02:49,722 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): regionserver:43903-0x100471fcd120002, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 06:02:49,722 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): regionserver:33981-0x100471fcd120001, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:02:49,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:02:49,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:02:49,723 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): regionserver:33981-0x100471fcd120001, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 06:02:49,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:02:49,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:02:49,723 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:49,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 06:02:49,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:02:49,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 06:02:49,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:02:49,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 06:02:49,728 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:49,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:02:49,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:02:49,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:02:49,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 06:02:49,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:49,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:49,730 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:49,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:02:49,730 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:49,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 06:02:49,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:49,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:49,737 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): regionserver:43903-0x100471fcd120002, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 06:02:49,737 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): regionserver:33981-0x100471fcd120001, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 06:02:49,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 06:02:49,737 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): regionserver:43903-0x100471fcd120002, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 06:02:49,737 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:49,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:02:49,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 06:02:49,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:02:49,737 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): regionserver:33981-0x100471fcd120001, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 06:02:49,737 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-12 06:02:49,737 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 06:02:49,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 06:02:49,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:02:49,737 DEBUG [(jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:02:49,737 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 06:02:49,737 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:49,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 06:02:49,738 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 06:02:49,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:02:49,738 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:49,738 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 06:02:49,738 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:49,738 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 06:02:49,738 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:02:49,740 DEBUG [Listener at localhost/44119] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-12 06:02:49,740 DEBUG [Listener at localhost/44119] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 06:02:49,838 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 06:02:49,839 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-12 06:02:49,840 DEBUG [Listener at localhost/44119] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 06:02:49,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 06:02:49,949 DEBUG [Listener at localhost/44119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7/hadoop-1632594824681325310.jar 2023-02-12 06:02:49,966 INFO [Listener at localhost/44119] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676181766653 type: FLUSH version: 2 ttl: 0 2023-02-12 06:02:49,967 DEBUG [Listener at localhost/44119] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596/data/default/testWithMapReduce 2023-02-12 06:02:49,968 INFO [Listener at localhost/44119] snapshot.RestoreSnapshotHelper(239): region to add: ce3f693b6332926321d72525ad1f0592 2023-02-12 06:02:49,968 INFO [Listener at localhost/44119] snapshot.RestoreSnapshotHelper(239): region to add: 8179ea2f8e67c4dfba2d173b7540832f 2023-02-12 06:02:49,968 INFO [Listener at localhost/44119] snapshot.RestoreSnapshotHelper(239): region to add: 5f4fabd8d4e0ff0b3e3d8eab4c9899ca 2023-02-12 06:02:49,968 INFO [Listener at localhost/44119] snapshot.RestoreSnapshotHelper(239): region to add: 9d3a93d53da6320c4938e8cef9659b7c 2023-02-12 06:02:49,968 INFO [Listener at localhost/44119] snapshot.RestoreSnapshotHelper(239): region to add: 305521ef65605b0ecbb78cb79cda5d7e 2023-02-12 06:02:49,968 INFO [Listener at localhost/44119] snapshot.RestoreSnapshotHelper(239): region to add: a628981a708add40d0832641d94930a1 2023-02-12 06:02:49,968 INFO [Listener at localhost/44119] snapshot.RestoreSnapshotHelper(239): region to add: e5810b3e54afabb05e70eb1e55b617c0 2023-02-12 06:02:49,968 INFO [Listener at localhost/44119] snapshot.RestoreSnapshotHelper(239): region to add: 318c101741f622a7a64c9c89324799b2 2023-02-12 06:02:49,968 INFO [Listener at localhost/44119] snapshot.RestoreSnapshotHelper(239): region to add: ede1a2ead4c611c9c8e6e77d11191a1d 2023-02-12 06:02:49,969 INFO [Listener at localhost/44119] snapshot.RestoreSnapshotHelper(239): region to add: a108e70c13825ee3f5ff04e1a1a26976 2023-02-12 06:02:49,969 INFO [Listener at localhost/44119] snapshot.RestoreSnapshotHelper(585): clone region=ce3f693b6332926321d72525ad1f0592 as ce3f693b6332926321d72525ad1f0592 in snapshot testWithMapReduceMultiRegion 2023-02-12 06:02:49,969 INFO [Listener at localhost/44119] snapshot.RestoreSnapshotHelper(585): clone region=8179ea2f8e67c4dfba2d173b7540832f as 8179ea2f8e67c4dfba2d173b7540832f in snapshot testWithMapReduceMultiRegion 2023-02-12 06:02:49,969 INFO [Listener at localhost/44119] snapshot.RestoreSnapshotHelper(585): clone region=5f4fabd8d4e0ff0b3e3d8eab4c9899ca as 5f4fabd8d4e0ff0b3e3d8eab4c9899ca in snapshot testWithMapReduceMultiRegion 2023-02-12 06:02:49,969 INFO [Listener at localhost/44119] snapshot.RestoreSnapshotHelper(585): clone region=9d3a93d53da6320c4938e8cef9659b7c as 9d3a93d53da6320c4938e8cef9659b7c in snapshot testWithMapReduceMultiRegion 2023-02-12 06:02:49,969 INFO [Listener at localhost/44119] snapshot.RestoreSnapshotHelper(585): clone region=305521ef65605b0ecbb78cb79cda5d7e as 305521ef65605b0ecbb78cb79cda5d7e in snapshot testWithMapReduceMultiRegion 2023-02-12 06:02:49,969 INFO [Listener at localhost/44119] snapshot.RestoreSnapshotHelper(585): clone region=a628981a708add40d0832641d94930a1 as a628981a708add40d0832641d94930a1 in snapshot testWithMapReduceMultiRegion 2023-02-12 06:02:49,969 INFO [Listener at localhost/44119] snapshot.RestoreSnapshotHelper(585): clone region=e5810b3e54afabb05e70eb1e55b617c0 as e5810b3e54afabb05e70eb1e55b617c0 in snapshot testWithMapReduceMultiRegion 2023-02-12 06:02:49,969 INFO [Listener at localhost/44119] snapshot.RestoreSnapshotHelper(585): clone region=318c101741f622a7a64c9c89324799b2 as 318c101741f622a7a64c9c89324799b2 in snapshot testWithMapReduceMultiRegion 2023-02-12 06:02:49,969 INFO [Listener at localhost/44119] snapshot.RestoreSnapshotHelper(585): clone region=ede1a2ead4c611c9c8e6e77d11191a1d as ede1a2ead4c611c9c8e6e77d11191a1d in snapshot testWithMapReduceMultiRegion 2023-02-12 06:02:49,969 INFO [Listener at localhost/44119] snapshot.RestoreSnapshotHelper(585): clone region=a108e70c13825ee3f5ff04e1a1a26976 as a108e70c13825ee3f5ff04e1a1a26976 in snapshot testWithMapReduceMultiRegion 2023-02-12 06:02:49,973 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 5f4fabd8d4e0ff0b3e3d8eab4c9899ca, NAME => 'testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596 2023-02-12 06:02:49,973 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 8179ea2f8e67c4dfba2d173b7540832f, NAME => 'testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596 2023-02-12 06:02:49,973 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 9d3a93d53da6320c4938e8cef9659b7c, NAME => 'testWithMapReduce,m\xED\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596 2023-02-12 06:02:49,973 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 305521ef65605b0ecbb78cb79cda5d7e, NAME => 'testWithMapReduce,q\x11\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596 2023-02-12 06:02:49,973 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => ce3f693b6332926321d72525ad1f0592, NAME => 'testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596 2023-02-12 06:02:49,976 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => a628981a708add40d0832641d94930a1, NAME => 'testWithMapReduce,g\xA7\xA7,1676181764917.a628981a708add40d0832641d94930a1.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596 2023-02-12 06:02:49,976 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => e5810b3e54afabb05e70eb1e55b617c0, NAME => 'testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596 2023-02-12 06:02:49,977 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 318c101741f622a7a64c9c89324799b2, NAME => 'testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596 2023-02-12 06:02:50,020 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:50,020 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5e373fe3670d4f07bbc4fbcd94739b17 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 06:02:50,032 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:50,032 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:50,032 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 04db54a59dd947d69d87f408df68b233 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 06:02:50,032 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 496d2656ee684894a3923bbb24127753 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 06:02:50,034 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:50,034 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing e5810b3e54afabb05e70eb1e55b617c0, disabling compactions & flushes 2023-02-12 06:02:50,034 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0. 2023-02-12 06:02:50,034 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0. 2023-02-12 06:02:50,034 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0. after waiting 0 ms 2023-02-12 06:02:50,034 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0. 2023-02-12 06:02:50,034 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0. 2023-02-12 06:02:50,034 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for e5810b3e54afabb05e70eb1e55b617c0: Waiting for close lock at 1676181770034Disabling compacts and flushes for region at 1676181770034Disabling writes for close at 1676181770034Writing region close event to WAL at 1676181770034Closed at 1676181770034 2023-02-12 06:02:50,035 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => ede1a2ead4c611c9c8e6e77d11191a1d, NAME => 'testWithMapReduce,j\xCA\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596 2023-02-12 06:02:50,036 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c7c991ed20e142b7b9c25fa14ef8e8c1 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 06:02:50,037 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676181764917.a628981a708add40d0832641d94930a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:50,037 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 959b2c5834634c4db9efe3ec6c427418 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 06:02:50,037 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:50,038 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 8179ea2f8e67c4dfba2d173b7540832f, disabling compactions & flushes 2023-02-12 06:02:50,038 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f. 2023-02-12 06:02:50,038 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f. 2023-02-12 06:02:50,038 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f. after waiting 0 ms 2023-02-12 06:02:50,038 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f. 2023-02-12 06:02:50,038 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f. 2023-02-12 06:02:50,038 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 8179ea2f8e67c4dfba2d173b7540832f: Waiting for close lock at 1676181770038Disabling compacts and flushes for region at 1676181770038Disabling writes for close at 1676181770038Writing region close event to WAL at 1676181770038Closed at 1676181770038 2023-02-12 06:02:50,038 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:50,039 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 22b6342600244813bdd116a47900b8b8 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 06:02:50,039 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => a108e70c13825ee3f5ff04e1a1a26976, NAME => 'testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596 2023-02-12 06:02:50,056 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 082b13d4196f4b51bcefd14687a1f46d from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 06:02:50,060 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ff08c997325a403e90c32b594b2bf7bf from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 06:02:50,064 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0afb16a97b384baa986ce2acfbf7a883 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 06:02:50,065 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 5f4fabd8d4e0ff0b3e3d8eab4c9899ca, disabling compactions & flushes 2023-02-12 06:02:50,065 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca. 2023-02-12 06:02:50,065 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca. 2023-02-12 06:02:50,065 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca. after waiting 0 ms 2023-02-12 06:02:50,065 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca. 2023-02-12 06:02:50,065 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca. 2023-02-12 06:02:50,065 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 5f4fabd8d4e0ff0b3e3d8eab4c9899ca: Waiting for close lock at 1676181770065Disabling compacts and flushes for region at 1676181770065Disabling writes for close at 1676181770065Writing region close event to WAL at 1676181770065Closed at 1676181770065 2023-02-12 06:02:50,075 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 36901009def44729b60b0ed26d7c9c5e from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 06:02:50,075 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 305521ef65605b0ecbb78cb79cda5d7e, disabling compactions & flushes 2023-02-12 06:02:50,075 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e. 2023-02-12 06:02:50,075 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e. 2023-02-12 06:02:50,075 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e. after waiting 0 ms 2023-02-12 06:02:50,075 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e. 2023-02-12 06:02:50,075 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e. 2023-02-12 06:02:50,075 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 305521ef65605b0ecbb78cb79cda5d7e: Waiting for close lock at 1676181770075Disabling compacts and flushes for region at 1676181770075Disabling writes for close at 1676181770075Writing region close event to WAL at 1676181770075Closed at 1676181770075 2023-02-12 06:02:50,076 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing ce3f693b6332926321d72525ad1f0592, disabling compactions & flushes 2023-02-12 06:02:50,076 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 9d3a93d53da6320c4938e8cef9659b7c, disabling compactions & flushes 2023-02-12 06:02:50,076 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592. 2023-02-12 06:02:50,076 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592. 2023-02-12 06:02:50,076 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592. after waiting 0 ms 2023-02-12 06:02:50,076 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592. 2023-02-12 06:02:50,076 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592. 2023-02-12 06:02:50,076 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for ce3f693b6332926321d72525ad1f0592: Waiting for close lock at 1676181770076Disabling compacts and flushes for region at 1676181770076Disabling writes for close at 1676181770076Writing region close event to WAL at 1676181770076Closed at 1676181770076 2023-02-12 06:02:50,077 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c. 2023-02-12 06:02:50,077 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c. 2023-02-12 06:02:50,077 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c. after waiting 0 ms 2023-02-12 06:02:50,077 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c. 2023-02-12 06:02:50,077 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c. 2023-02-12 06:02:50,077 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 9d3a93d53da6320c4938e8cef9659b7c: Waiting for close lock at 1676181770076Disabling compacts and flushes for region at 1676181770076Disabling writes for close at 1676181770077 (+1 ms)Writing region close event to WAL at 1676181770077Closed at 1676181770077 2023-02-12 06:02:50,080 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:50,080 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d2c10c710bb74381a077db4f5a8aa70e from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 06:02:50,088 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing a628981a708add40d0832641d94930a1, disabling compactions & flushes 2023-02-12 06:02:50,088 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676181764917.a628981a708add40d0832641d94930a1. 2023-02-12 06:02:50,088 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676181764917.a628981a708add40d0832641d94930a1. 2023-02-12 06:02:50,088 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676181764917.a628981a708add40d0832641d94930a1. after waiting 0 ms 2023-02-12 06:02:50,088 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676181764917.a628981a708add40d0832641d94930a1. 2023-02-12 06:02:50,088 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676181764917.a628981a708add40d0832641d94930a1. 2023-02-12 06:02:50,088 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for a628981a708add40d0832641d94930a1: Waiting for close lock at 1676181770088Disabling compacts and flushes for region at 1676181770088Disabling writes for close at 1676181770088Writing region close event to WAL at 1676181770088Closed at 1676181770088 2023-02-12 06:02:50,089 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9799e4fd82874858a03798f705647159 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 06:02:50,091 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:50,091 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c1e8de00e2d242c588e62e77ab8d267b from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 06:02:50,092 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing a108e70c13825ee3f5ff04e1a1a26976, disabling compactions & flushes 2023-02-12 06:02:50,092 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976. 2023-02-12 06:02:50,092 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976. 2023-02-12 06:02:50,092 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976. after waiting 0 ms 2023-02-12 06:02:50,092 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976. 2023-02-12 06:02:50,092 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976. 2023-02-12 06:02:50,092 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for a108e70c13825ee3f5ff04e1a1a26976: Waiting for close lock at 1676181770092Disabling compacts and flushes for region at 1676181770092Disabling writes for close at 1676181770092Writing region close event to WAL at 1676181770092Closed at 1676181770092 2023-02-12 06:02:50,094 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 04019d7c88ba4a3f96feee1fa33432e5 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 06:02:50,096 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing ede1a2ead4c611c9c8e6e77d11191a1d, disabling compactions & flushes 2023-02-12 06:02:50,096 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d. 2023-02-12 06:02:50,096 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d. 2023-02-12 06:02:50,096 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d. after waiting 0 ms 2023-02-12 06:02:50,096 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d. 2023-02-12 06:02:50,096 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d. 2023-02-12 06:02:50,096 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for ede1a2ead4c611c9c8e6e77d11191a1d: Waiting for close lock at 1676181770096Disabling compacts and flushes for region at 1676181770096Disabling writes for close at 1676181770096Writing region close event to WAL at 1676181770096Closed at 1676181770096 2023-02-12 06:02:50,441 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:50,442 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5bbfd03016ad40e9a47aa343963a9932 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 06:02:50,445 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ec3b46a9acd74245b3888084b2815d64 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-12 06:02:50,447 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 318c101741f622a7a64c9c89324799b2, disabling compactions & flushes 2023-02-12 06:02:50,447 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2. 2023-02-12 06:02:50,447 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2. 2023-02-12 06:02:50,447 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2. after waiting 0 ms 2023-02-12 06:02:50,447 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2. 2023-02-12 06:02:50,447 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2. 2023-02-12 06:02:50,448 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 318c101741f622a7a64c9c89324799b2: Waiting for close lock at 1676181770447Disabling compacts and flushes for region at 1676181770447Disabling writes for close at 1676181770447Writing region close event to WAL at 1676181770447Closed at 1676181770447 2023-02-12 06:02:50,448 INFO [Listener at localhost/44119] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676181766653 type: FLUSH version: 2 ttl: 0 2023-02-12 06:02:50,448 DEBUG [Listener at localhost/44119] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596 2023-02-12 06:02:50,448 DEBUG [Listener at localhost/44119] util.CommonFSUtils(682): File system contents for path hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596 2023-02-12 06:02:50,449 DEBUG [Listener at localhost/44119] util.CommonFSUtils(699): |-data/ 2023-02-12 06:02:50,449 DEBUG [Listener at localhost/44119] util.CommonFSUtils(699): |----default/ 2023-02-12 06:02:50,450 DEBUG [Listener at localhost/44119] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-12 06:02:50,451 DEBUG [Listener at localhost/44119] util.CommonFSUtils(699): |----------305521ef65605b0ecbb78cb79cda5d7e/ 2023-02-12 06:02:50,451 DEBUG [Listener at localhost/44119] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 06:02:50,452 DEBUG [Listener at localhost/44119] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 06:02:50,452 DEBUG [Listener at localhost/44119] util.CommonFSUtils(702): |----------------testWithMapReduce=305521ef65605b0ecbb78cb79cda5d7e-04db54a59dd947d69d87f408df68b233 2023-02-12 06:02:50,452 DEBUG [Listener at localhost/44119] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 06:02:50,453 DEBUG [Listener at localhost/44119] util.CommonFSUtils(702): |----------------testWithMapReduce=305521ef65605b0ecbb78cb79cda5d7e-082b13d4196f4b51bcefd14687a1f46d 2023-02-12 06:02:50,453 DEBUG [Listener at localhost/44119] util.CommonFSUtils(699): |----------318c101741f622a7a64c9c89324799b2/ 2023-02-12 06:02:50,453 DEBUG [Listener at localhost/44119] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 06:02:50,453 DEBUG [Listener at localhost/44119] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 06:02:50,454 DEBUG [Listener at localhost/44119] util.CommonFSUtils(702): |----------------testWithMapReduce=318c101741f622a7a64c9c89324799b2-5bbfd03016ad40e9a47aa343963a9932 2023-02-12 06:02:50,454 DEBUG [Listener at localhost/44119] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 06:02:50,454 DEBUG [Listener at localhost/44119] util.CommonFSUtils(702): |----------------testWithMapReduce=318c101741f622a7a64c9c89324799b2-ec3b46a9acd74245b3888084b2815d64 2023-02-12 06:02:50,455 DEBUG [Listener at localhost/44119] util.CommonFSUtils(699): |----------5f4fabd8d4e0ff0b3e3d8eab4c9899ca/ 2023-02-12 06:02:50,455 DEBUG [Listener at localhost/44119] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 06:02:50,455 DEBUG [Listener at localhost/44119] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 06:02:50,456 DEBUG [Listener at localhost/44119] util.CommonFSUtils(702): |----------------testWithMapReduce=5f4fabd8d4e0ff0b3e3d8eab4c9899ca-5e373fe3670d4f07bbc4fbcd94739b17 2023-02-12 06:02:50,456 DEBUG [Listener at localhost/44119] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 06:02:50,456 DEBUG [Listener at localhost/44119] util.CommonFSUtils(702): |----------------testWithMapReduce=5f4fabd8d4e0ff0b3e3d8eab4c9899ca-c7c991ed20e142b7b9c25fa14ef8e8c1 2023-02-12 06:02:50,456 DEBUG [Listener at localhost/44119] util.CommonFSUtils(699): |----------8179ea2f8e67c4dfba2d173b7540832f/ 2023-02-12 06:02:50,457 DEBUG [Listener at localhost/44119] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 06:02:50,457 DEBUG [Listener at localhost/44119] util.CommonFSUtils(699): |----------9d3a93d53da6320c4938e8cef9659b7c/ 2023-02-12 06:02:50,458 DEBUG [Listener at localhost/44119] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 06:02:50,458 DEBUG [Listener at localhost/44119] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 06:02:50,458 DEBUG [Listener at localhost/44119] util.CommonFSUtils(702): |----------------testWithMapReduce=9d3a93d53da6320c4938e8cef9659b7c-22b6342600244813bdd116a47900b8b8 2023-02-12 06:02:50,458 DEBUG [Listener at localhost/44119] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 06:02:50,459 DEBUG [Listener at localhost/44119] util.CommonFSUtils(702): |----------------testWithMapReduce=9d3a93d53da6320c4938e8cef9659b7c-0afb16a97b384baa986ce2acfbf7a883 2023-02-12 06:02:50,459 DEBUG [Listener at localhost/44119] util.CommonFSUtils(699): |----------a108e70c13825ee3f5ff04e1a1a26976/ 2023-02-12 06:02:50,460 DEBUG [Listener at localhost/44119] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 06:02:50,460 DEBUG [Listener at localhost/44119] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 06:02:50,460 DEBUG [Listener at localhost/44119] util.CommonFSUtils(702): |----------------testWithMapReduce=a108e70c13825ee3f5ff04e1a1a26976-d2c10c710bb74381a077db4f5a8aa70e 2023-02-12 06:02:50,461 DEBUG [Listener at localhost/44119] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 06:02:50,461 DEBUG [Listener at localhost/44119] util.CommonFSUtils(702): |----------------testWithMapReduce=a108e70c13825ee3f5ff04e1a1a26976-9799e4fd82874858a03798f705647159 2023-02-12 06:02:50,461 DEBUG [Listener at localhost/44119] util.CommonFSUtils(699): |----------a628981a708add40d0832641d94930a1/ 2023-02-12 06:02:50,462 DEBUG [Listener at localhost/44119] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 06:02:50,462 DEBUG [Listener at localhost/44119] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 06:02:50,462 DEBUG [Listener at localhost/44119] util.CommonFSUtils(702): |----------------testWithMapReduce=a628981a708add40d0832641d94930a1-959b2c5834634c4db9efe3ec6c427418 2023-02-12 06:02:50,462 DEBUG [Listener at localhost/44119] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 06:02:50,463 DEBUG [Listener at localhost/44119] util.CommonFSUtils(702): |----------------testWithMapReduce=a628981a708add40d0832641d94930a1-36901009def44729b60b0ed26d7c9c5e 2023-02-12 06:02:50,463 DEBUG [Listener at localhost/44119] util.CommonFSUtils(699): |----------ce3f693b6332926321d72525ad1f0592/ 2023-02-12 06:02:50,463 DEBUG [Listener at localhost/44119] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 06:02:50,463 DEBUG [Listener at localhost/44119] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 06:02:50,464 DEBUG [Listener at localhost/44119] util.CommonFSUtils(702): |----------------testWithMapReduce=ce3f693b6332926321d72525ad1f0592-496d2656ee684894a3923bbb24127753 2023-02-12 06:02:50,464 DEBUG [Listener at localhost/44119] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 06:02:50,465 DEBUG [Listener at localhost/44119] util.CommonFSUtils(702): |----------------testWithMapReduce=ce3f693b6332926321d72525ad1f0592-ff08c997325a403e90c32b594b2bf7bf 2023-02-12 06:02:50,465 DEBUG [Listener at localhost/44119] util.CommonFSUtils(699): |----------e5810b3e54afabb05e70eb1e55b617c0/ 2023-02-12 06:02:50,465 DEBUG [Listener at localhost/44119] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 06:02:50,465 DEBUG [Listener at localhost/44119] util.CommonFSUtils(699): |----------ede1a2ead4c611c9c8e6e77d11191a1d/ 2023-02-12 06:02:50,466 DEBUG [Listener at localhost/44119] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 06:02:50,466 DEBUG [Listener at localhost/44119] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 06:02:50,467 DEBUG [Listener at localhost/44119] util.CommonFSUtils(702): |----------------testWithMapReduce=ede1a2ead4c611c9c8e6e77d11191a1d-c1e8de00e2d242c588e62e77ab8d267b 2023-02-12 06:02:50,467 DEBUG [Listener at localhost/44119] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 06:02:50,467 DEBUG [Listener at localhost/44119] util.CommonFSUtils(702): |----------------testWithMapReduce=ede1a2ead4c611c9c8e6e77d11191a1d-04019d7c88ba4a3f96feee1fa33432e5 2023-02-12 06:02:50,476 DEBUG [Listener at localhost/44119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-12 06:02:50,477 DEBUG [Listener at localhost/44119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-12 06:02:50,477 DEBUG [Listener at localhost/44119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-12 06:02:50,477 DEBUG [Listener at localhost/44119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-12 06:02:51,476 DEBUG [Listener at localhost/44119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7/hadoop-292714900790044654.jar 2023-02-12 06:02:51,477 DEBUG [Listener at localhost/44119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-12 06:02:51,478 DEBUG [Listener at localhost/44119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-12 06:02:51,555 DEBUG [Listener at localhost/44119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7/hadoop-7335425676372188306.jar 2023-02-12 06:02:51,556 DEBUG [Listener at localhost/44119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-12 06:02:51,556 DEBUG [Listener at localhost/44119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-12 06:02:51,557 DEBUG [Listener at localhost/44119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-12 06:02:51,557 DEBUG [Listener at localhost/44119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-12 06:02:51,558 DEBUG [Listener at localhost/44119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-12 06:02:51,558 DEBUG [Listener at localhost/44119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-12 06:02:51,558 DEBUG [Listener at localhost/44119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-12 06:02:51,559 DEBUG [Listener at localhost/44119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-12 06:02:51,560 DEBUG [Listener at localhost/44119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-12 06:02:51,560 DEBUG [Listener at localhost/44119] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-12 06:02:51,561 DEBUG [Listener at localhost/44119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-12 06:02:51,561 DEBUG [Listener at localhost/44119] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-12 06:02:51,562 DEBUG [Listener at localhost/44119] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-12 06:02:51,562 DEBUG [Listener at localhost/44119] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-12 06:02:51,563 DEBUG [Listener at localhost/44119] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-12 06:02:51,564 DEBUG [Listener at localhost/44119] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-12 06:02:51,570 DEBUG [Listener at localhost/44119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-12 06:02:51,571 DEBUG [Listener at localhost/44119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 06:02:51,571 DEBUG [Listener at localhost/44119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 06:02:51,572 DEBUG [Listener at localhost/44119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 06:02:51,572 DEBUG [Listener at localhost/44119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-12 06:02:51,656 DEBUG [Listener at localhost/44119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7/hadoop-8324653294582062675.jar 2023-02-12 06:02:51,657 DEBUG [Listener at localhost/44119] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-12 06:02:51,713 WARN [Listener at localhost/44119] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-12 06:02:51,725 WARN [Listener at localhost/44119] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-12 06:02:51,739 INFO [Listener at localhost/44119] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-12 06:02:52,118 WARN [Listener at localhost/44119] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7/mapreduce.cluster.local.dir/1676181772042/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-12 06:02:52,118 WARN [Listener at localhost/44119] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7/mapreduce.cluster.local.dir/1676181772042/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-12 06:02:52,260 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:52,260 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 06:02:52,262 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:02:52,264 INFO [StoreOpener-305521ef65605b0ecbb78cb79cda5d7e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 305521ef65605b0ecbb78cb79cda5d7e 2023-02-12 06:02:52,265 DEBUG [StoreOpener-305521ef65605b0ecbb78cb79cda5d7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/f1 2023-02-12 06:02:52,266 INFO [StoreOpener-305521ef65605b0ecbb78cb79cda5d7e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 305521ef65605b0ecbb78cb79cda5d7e columnFamilyName f1 2023-02-12 06:02:52,277 DEBUG [StoreOpener-305521ef65605b0ecbb78cb79cda5d7e-1] regionserver.HStore(539): loaded hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/f1/testWithMapReduce=305521ef65605b0ecbb78cb79cda5d7e-04db54a59dd947d69d87f408df68b233 2023-02-12 06:02:52,277 INFO [StoreOpener-305521ef65605b0ecbb78cb79cda5d7e-1] regionserver.HStore(310): Store=305521ef65605b0ecbb78cb79cda5d7e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:52,278 INFO [StoreOpener-305521ef65605b0ecbb78cb79cda5d7e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 305521ef65605b0ecbb78cb79cda5d7e 2023-02-12 06:02:52,279 DEBUG [StoreOpener-305521ef65605b0ecbb78cb79cda5d7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/f2 2023-02-12 06:02:52,279 INFO [StoreOpener-305521ef65605b0ecbb78cb79cda5d7e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 305521ef65605b0ecbb78cb79cda5d7e columnFamilyName f2 2023-02-12 06:02:52,285 DEBUG [StoreOpener-305521ef65605b0ecbb78cb79cda5d7e-1] regionserver.HStore(539): loaded hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/f2/testWithMapReduce=305521ef65605b0ecbb78cb79cda5d7e-082b13d4196f4b51bcefd14687a1f46d 2023-02-12 06:02:52,285 INFO [StoreOpener-305521ef65605b0ecbb78cb79cda5d7e-1] regionserver.HStore(310): Store=305521ef65605b0ecbb78cb79cda5d7e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:52,286 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:02:52,286 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 305521ef65605b0ecbb78cb79cda5d7e; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69428771, jitterRate=0.034569308161735535}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:02:52,286 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 305521ef65605b0ecbb78cb79cda5d7e: Writing region info on filesystem at 1676181772262Initializing all the Stores at 1676181772263 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181772263Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181772264 (+1 ms)Region opened successfully at 1676181772286 (+22 ms) 2023-02-12 06:02:52,459 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 305521ef65605b0ecbb78cb79cda5d7e, disabling compactions & flushes 2023-02-12 06:02:52,459 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e. 2023-02-12 06:02:52,459 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e. 2023-02-12 06:02:52,459 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e. after waiting 0 ms 2023-02-12 06:02:52,460 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e. 2023-02-12 06:02:52,466 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e. 2023-02-12 06:02:52,466 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 305521ef65605b0ecbb78cb79cda5d7e: Waiting for close lock at 1676181772459Disabling compacts and flushes for region at 1676181772459Disabling writes for close at 1676181772460 (+1 ms)Writing region close event to WAL at 1676181772466 (+6 ms)Closed at 1676181772466 2023-02-12 06:02:52,484 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:52,484 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 06:02:52,485 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:02:52,487 INFO [StoreOpener-ce3f693b6332926321d72525ad1f0592-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ce3f693b6332926321d72525ad1f0592 2023-02-12 06:02:52,489 DEBUG [StoreOpener-ce3f693b6332926321d72525ad1f0592-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/f1 2023-02-12 06:02:52,489 INFO [StoreOpener-ce3f693b6332926321d72525ad1f0592-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ce3f693b6332926321d72525ad1f0592 columnFamilyName f1 2023-02-12 06:02:52,497 DEBUG [StoreOpener-ce3f693b6332926321d72525ad1f0592-1] regionserver.HStore(539): loaded hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/f1/testWithMapReduce=ce3f693b6332926321d72525ad1f0592-496d2656ee684894a3923bbb24127753 2023-02-12 06:02:52,497 INFO [StoreOpener-ce3f693b6332926321d72525ad1f0592-1] regionserver.HStore(310): Store=ce3f693b6332926321d72525ad1f0592/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:52,498 INFO [StoreOpener-ce3f693b6332926321d72525ad1f0592-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ce3f693b6332926321d72525ad1f0592 2023-02-12 06:02:52,499 DEBUG [StoreOpener-ce3f693b6332926321d72525ad1f0592-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/f2 2023-02-12 06:02:52,499 INFO [StoreOpener-ce3f693b6332926321d72525ad1f0592-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ce3f693b6332926321d72525ad1f0592 columnFamilyName f2 2023-02-12 06:02:52,506 DEBUG [StoreOpener-ce3f693b6332926321d72525ad1f0592-1] regionserver.HStore(539): loaded hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/f2/testWithMapReduce=ce3f693b6332926321d72525ad1f0592-ff08c997325a403e90c32b594b2bf7bf 2023-02-12 06:02:52,506 INFO [StoreOpener-ce3f693b6332926321d72525ad1f0592-1] regionserver.HStore(310): Store=ce3f693b6332926321d72525ad1f0592/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:52,507 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:02:52,507 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened ce3f693b6332926321d72525ad1f0592; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66538533, jitterRate=-0.008498594164848328}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:02:52,507 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for ce3f693b6332926321d72525ad1f0592: Writing region info on filesystem at 1676181772485Initializing all the Stores at 1676181772487 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181772487Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181772487Region opened successfully at 1676181772507 (+20 ms) 2023-02-12 06:02:52,588 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing ce3f693b6332926321d72525ad1f0592, disabling compactions & flushes 2023-02-12 06:02:52,588 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592. 2023-02-12 06:02:52,588 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592. 2023-02-12 06:02:52,588 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592. after waiting 0 ms 2023-02-12 06:02:52,588 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592. 2023-02-12 06:02:52,591 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592. 2023-02-12 06:02:52,592 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for ce3f693b6332926321d72525ad1f0592: Waiting for close lock at 1676181772588Disabling compacts and flushes for region at 1676181772588Disabling writes for close at 1676181772588Writing region close event to WAL at 1676181772591 (+3 ms)Closed at 1676181772591 2023-02-12 06:02:52,597 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:52,598 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 06:02:52,600 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:02:52,604 INFO [StoreOpener-8179ea2f8e67c4dfba2d173b7540832f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8179ea2f8e67c4dfba2d173b7540832f 2023-02-12 06:02:52,606 DEBUG [StoreOpener-8179ea2f8e67c4dfba2d173b7540832f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596/data/default/testWithMapReduce/8179ea2f8e67c4dfba2d173b7540832f/f1 2023-02-12 06:02:52,607 INFO [StoreOpener-8179ea2f8e67c4dfba2d173b7540832f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8179ea2f8e67c4dfba2d173b7540832f columnFamilyName f1 2023-02-12 06:02:52,607 INFO [StoreOpener-8179ea2f8e67c4dfba2d173b7540832f-1] regionserver.HStore(310): Store=8179ea2f8e67c4dfba2d173b7540832f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:52,607 INFO [StoreOpener-8179ea2f8e67c4dfba2d173b7540832f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8179ea2f8e67c4dfba2d173b7540832f 2023-02-12 06:02:52,609 DEBUG [StoreOpener-8179ea2f8e67c4dfba2d173b7540832f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596/data/default/testWithMapReduce/8179ea2f8e67c4dfba2d173b7540832f/f2 2023-02-12 06:02:52,609 INFO [StoreOpener-8179ea2f8e67c4dfba2d173b7540832f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8179ea2f8e67c4dfba2d173b7540832f columnFamilyName f2 2023-02-12 06:02:52,610 INFO [StoreOpener-8179ea2f8e67c4dfba2d173b7540832f-1] regionserver.HStore(310): Store=8179ea2f8e67c4dfba2d173b7540832f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:52,611 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:02:52,611 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 8179ea2f8e67c4dfba2d173b7540832f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75427722, jitterRate=0.12396064400672913}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:02:52,611 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 8179ea2f8e67c4dfba2d173b7540832f: Writing region info on filesystem at 1676181772600Initializing all the Stores at 1676181772602 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181772602Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181772604 (+2 ms)Region opened successfully at 1676181772611 (+7 ms) 2023-02-12 06:02:52,628 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 8179ea2f8e67c4dfba2d173b7540832f, disabling compactions & flushes 2023-02-12 06:02:52,628 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f. 2023-02-12 06:02:52,628 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f. 2023-02-12 06:02:52,628 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f. after waiting 0 ms 2023-02-12 06:02:52,628 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f. 2023-02-12 06:02:52,632 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f. 2023-02-12 06:02:52,632 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 8179ea2f8e67c4dfba2d173b7540832f: Waiting for close lock at 1676181772628Disabling compacts and flushes for region at 1676181772628Disabling writes for close at 1676181772628Writing region close event to WAL at 1676181772632 (+4 ms)Closed at 1676181772632 2023-02-12 06:02:52,637 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:52,637 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 06:02:52,639 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:02:52,643 INFO [StoreOpener-5f4fabd8d4e0ff0b3e3d8eab4c9899ca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5f4fabd8d4e0ff0b3e3d8eab4c9899ca 2023-02-12 06:02:52,644 DEBUG [StoreOpener-5f4fabd8d4e0ff0b3e3d8eab4c9899ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/f1 2023-02-12 06:02:52,644 INFO [StoreOpener-5f4fabd8d4e0ff0b3e3d8eab4c9899ca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f4fabd8d4e0ff0b3e3d8eab4c9899ca columnFamilyName f1 2023-02-12 06:02:52,650 DEBUG [StoreOpener-5f4fabd8d4e0ff0b3e3d8eab4c9899ca-1] regionserver.HStore(539): loaded hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/f1/testWithMapReduce=5f4fabd8d4e0ff0b3e3d8eab4c9899ca-5e373fe3670d4f07bbc4fbcd94739b17 2023-02-12 06:02:52,651 INFO [StoreOpener-5f4fabd8d4e0ff0b3e3d8eab4c9899ca-1] regionserver.HStore(310): Store=5f4fabd8d4e0ff0b3e3d8eab4c9899ca/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:52,651 INFO [StoreOpener-5f4fabd8d4e0ff0b3e3d8eab4c9899ca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5f4fabd8d4e0ff0b3e3d8eab4c9899ca 2023-02-12 06:02:52,652 DEBUG [StoreOpener-5f4fabd8d4e0ff0b3e3d8eab4c9899ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/f2 2023-02-12 06:02:52,653 INFO [StoreOpener-5f4fabd8d4e0ff0b3e3d8eab4c9899ca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f4fabd8d4e0ff0b3e3d8eab4c9899ca columnFamilyName f2 2023-02-12 06:02:52,659 DEBUG [StoreOpener-5f4fabd8d4e0ff0b3e3d8eab4c9899ca-1] regionserver.HStore(539): loaded hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/f2/testWithMapReduce=5f4fabd8d4e0ff0b3e3d8eab4c9899ca-c7c991ed20e142b7b9c25fa14ef8e8c1 2023-02-12 06:02:52,659 INFO [StoreOpener-5f4fabd8d4e0ff0b3e3d8eab4c9899ca-1] regionserver.HStore(310): Store=5f4fabd8d4e0ff0b3e3d8eab4c9899ca/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:52,659 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:02:52,659 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 5f4fabd8d4e0ff0b3e3d8eab4c9899ca; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60252917, jitterRate=-0.10216157138347626}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:02:52,659 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 5f4fabd8d4e0ff0b3e3d8eab4c9899ca: Writing region info on filesystem at 1676181772639Initializing all the Stores at 1676181772640 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181772641 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181772642 (+1 ms)Region opened successfully at 1676181772659 (+17 ms) 2023-02-12 06:02:52,709 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 5f4fabd8d4e0ff0b3e3d8eab4c9899ca, disabling compactions & flushes 2023-02-12 06:02:52,709 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca. 2023-02-12 06:02:52,709 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca. 2023-02-12 06:02:52,710 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca. after waiting 0 ms 2023-02-12 06:02:52,710 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca. 2023-02-12 06:02:52,713 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca. 2023-02-12 06:02:52,713 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 5f4fabd8d4e0ff0b3e3d8eab4c9899ca: Waiting for close lock at 1676181772709Disabling compacts and flushes for region at 1676181772709Disabling writes for close at 1676181772710 (+1 ms)Writing region close event to WAL at 1676181772713 (+3 ms)Closed at 1676181772713 2023-02-12 06:02:52,719 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:52,719 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 06:02:52,720 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:02:52,722 INFO [StoreOpener-ede1a2ead4c611c9c8e6e77d11191a1d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ede1a2ead4c611c9c8e6e77d11191a1d 2023-02-12 06:02:52,723 DEBUG [StoreOpener-ede1a2ead4c611c9c8e6e77d11191a1d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/f1 2023-02-12 06:02:52,724 INFO [StoreOpener-ede1a2ead4c611c9c8e6e77d11191a1d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ede1a2ead4c611c9c8e6e77d11191a1d columnFamilyName f1 2023-02-12 06:02:52,731 DEBUG [StoreOpener-ede1a2ead4c611c9c8e6e77d11191a1d-1] regionserver.HStore(539): loaded hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/f1/testWithMapReduce=ede1a2ead4c611c9c8e6e77d11191a1d-c1e8de00e2d242c588e62e77ab8d267b 2023-02-12 06:02:52,732 INFO [StoreOpener-ede1a2ead4c611c9c8e6e77d11191a1d-1] regionserver.HStore(310): Store=ede1a2ead4c611c9c8e6e77d11191a1d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:52,732 INFO [StoreOpener-ede1a2ead4c611c9c8e6e77d11191a1d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ede1a2ead4c611c9c8e6e77d11191a1d 2023-02-12 06:02:52,733 DEBUG [StoreOpener-ede1a2ead4c611c9c8e6e77d11191a1d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/f2 2023-02-12 06:02:52,733 INFO [StoreOpener-ede1a2ead4c611c9c8e6e77d11191a1d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ede1a2ead4c611c9c8e6e77d11191a1d columnFamilyName f2 2023-02-12 06:02:52,740 DEBUG [StoreOpener-ede1a2ead4c611c9c8e6e77d11191a1d-1] regionserver.HStore(539): loaded hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/f2/testWithMapReduce=ede1a2ead4c611c9c8e6e77d11191a1d-04019d7c88ba4a3f96feee1fa33432e5 2023-02-12 06:02:52,740 INFO [StoreOpener-ede1a2ead4c611c9c8e6e77d11191a1d-1] regionserver.HStore(310): Store=ede1a2ead4c611c9c8e6e77d11191a1d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:52,741 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:02:52,741 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened ede1a2ead4c611c9c8e6e77d11191a1d; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67554824, jitterRate=0.006645321846008301}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:02:52,741 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for ede1a2ead4c611c9c8e6e77d11191a1d: Writing region info on filesystem at 1676181772720Initializing all the Stores at 1676181772721 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181772722 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181772722Region opened successfully at 1676181772741 (+19 ms) 2023-02-12 06:02:52,779 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing ede1a2ead4c611c9c8e6e77d11191a1d, disabling compactions & flushes 2023-02-12 06:02:52,779 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d. 2023-02-12 06:02:52,779 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d. 2023-02-12 06:02:52,780 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d. after waiting 0 ms 2023-02-12 06:02:52,780 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d. 2023-02-12 06:02:52,785 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d. 2023-02-12 06:02:52,785 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for ede1a2ead4c611c9c8e6e77d11191a1d: Waiting for close lock at 1676181772779Disabling compacts and flushes for region at 1676181772779Disabling writes for close at 1676181772780 (+1 ms)Writing region close event to WAL at 1676181772785 (+5 ms)Closed at 1676181772785 2023-02-12 06:02:52,790 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:52,790 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 06:02:52,794 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:02:52,796 INFO [StoreOpener-e5810b3e54afabb05e70eb1e55b617c0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e5810b3e54afabb05e70eb1e55b617c0 2023-02-12 06:02:52,798 DEBUG [StoreOpener-e5810b3e54afabb05e70eb1e55b617c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596/data/default/testWithMapReduce/e5810b3e54afabb05e70eb1e55b617c0/f1 2023-02-12 06:02:52,798 INFO [StoreOpener-e5810b3e54afabb05e70eb1e55b617c0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e5810b3e54afabb05e70eb1e55b617c0 columnFamilyName f1 2023-02-12 06:02:52,799 INFO [StoreOpener-e5810b3e54afabb05e70eb1e55b617c0-1] regionserver.HStore(310): Store=e5810b3e54afabb05e70eb1e55b617c0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:52,799 INFO [StoreOpener-e5810b3e54afabb05e70eb1e55b617c0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e5810b3e54afabb05e70eb1e55b617c0 2023-02-12 06:02:52,800 DEBUG [StoreOpener-e5810b3e54afabb05e70eb1e55b617c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596/data/default/testWithMapReduce/e5810b3e54afabb05e70eb1e55b617c0/f2 2023-02-12 06:02:52,801 INFO [StoreOpener-e5810b3e54afabb05e70eb1e55b617c0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e5810b3e54afabb05e70eb1e55b617c0 columnFamilyName f2 2023-02-12 06:02:52,801 INFO [StoreOpener-e5810b3e54afabb05e70eb1e55b617c0-1] regionserver.HStore(310): Store=e5810b3e54afabb05e70eb1e55b617c0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:52,802 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:02:52,802 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e5810b3e54afabb05e70eb1e55b617c0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66431023, jitterRate=-0.01010061800479889}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:02:52,802 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e5810b3e54afabb05e70eb1e55b617c0: Writing region info on filesystem at 1676181772794Initializing all the Stores at 1676181772795 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181772795Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181772796 (+1 ms)Region opened successfully at 1676181772802 (+6 ms) 2023-02-12 06:02:52,834 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e5810b3e54afabb05e70eb1e55b617c0, disabling compactions & flushes 2023-02-12 06:02:52,834 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0. 2023-02-12 06:02:52,834 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0. 2023-02-12 06:02:52,834 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0. after waiting 0 ms 2023-02-12 06:02:52,834 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0. 2023-02-12 06:02:52,835 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0. 2023-02-12 06:02:52,835 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e5810b3e54afabb05e70eb1e55b617c0: Waiting for close lock at 1676181772834Disabling compacts and flushes for region at 1676181772834Disabling writes for close at 1676181772834Writing region close event to WAL at 1676181772835 (+1 ms)Closed at 1676181772835 2023-02-12 06:02:52,838 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:52,838 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 06:02:52,841 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:02:52,843 INFO [StoreOpener-318c101741f622a7a64c9c89324799b2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 318c101741f622a7a64c9c89324799b2 2023-02-12 06:02:52,844 DEBUG [StoreOpener-318c101741f622a7a64c9c89324799b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/f1 2023-02-12 06:02:52,844 INFO [StoreOpener-318c101741f622a7a64c9c89324799b2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 318c101741f622a7a64c9c89324799b2 columnFamilyName f1 2023-02-12 06:02:52,850 DEBUG [StoreOpener-318c101741f622a7a64c9c89324799b2-1] regionserver.HStore(539): loaded hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/f1/testWithMapReduce=318c101741f622a7a64c9c89324799b2-5bbfd03016ad40e9a47aa343963a9932 2023-02-12 06:02:52,850 INFO [StoreOpener-318c101741f622a7a64c9c89324799b2-1] regionserver.HStore(310): Store=318c101741f622a7a64c9c89324799b2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:52,850 INFO [StoreOpener-318c101741f622a7a64c9c89324799b2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 318c101741f622a7a64c9c89324799b2 2023-02-12 06:02:52,852 DEBUG [StoreOpener-318c101741f622a7a64c9c89324799b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/f2 2023-02-12 06:02:52,852 INFO [StoreOpener-318c101741f622a7a64c9c89324799b2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 318c101741f622a7a64c9c89324799b2 columnFamilyName f2 2023-02-12 06:02:52,857 DEBUG [StoreOpener-318c101741f622a7a64c9c89324799b2-1] regionserver.HStore(539): loaded hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/f2/testWithMapReduce=318c101741f622a7a64c9c89324799b2-ec3b46a9acd74245b3888084b2815d64 2023-02-12 06:02:52,857 INFO [StoreOpener-318c101741f622a7a64c9c89324799b2-1] regionserver.HStore(310): Store=318c101741f622a7a64c9c89324799b2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:52,857 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:02:52,858 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 318c101741f622a7a64c9c89324799b2; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65064325, jitterRate=-0.030466005206108093}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:02:52,858 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 318c101741f622a7a64c9c89324799b2: Writing region info on filesystem at 1676181772841Initializing all the Stores at 1676181772842 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181772842Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181772842Region opened successfully at 1676181772858 (+16 ms) 2023-02-12 06:02:52,890 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 318c101741f622a7a64c9c89324799b2, disabling compactions & flushes 2023-02-12 06:02:52,890 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2. 2023-02-12 06:02:52,890 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2. 2023-02-12 06:02:52,890 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2. after waiting 0 ms 2023-02-12 06:02:52,890 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2. 2023-02-12 06:02:52,893 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2. 2023-02-12 06:02:52,893 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 318c101741f622a7a64c9c89324799b2: Waiting for close lock at 1676181772890Disabling compacts and flushes for region at 1676181772890Disabling writes for close at 1676181772890Writing region close event to WAL at 1676181772893 (+3 ms)Closed at 1676181772893 2023-02-12 06:02:52,897 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:52,898 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 06:02:52,902 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:02:52,904 INFO [StoreOpener-a108e70c13825ee3f5ff04e1a1a26976-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a108e70c13825ee3f5ff04e1a1a26976 2023-02-12 06:02:52,905 DEBUG [StoreOpener-a108e70c13825ee3f5ff04e1a1a26976-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/f1 2023-02-12 06:02:52,905 INFO [StoreOpener-a108e70c13825ee3f5ff04e1a1a26976-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a108e70c13825ee3f5ff04e1a1a26976 columnFamilyName f1 2023-02-12 06:02:52,912 DEBUG [StoreOpener-a108e70c13825ee3f5ff04e1a1a26976-1] regionserver.HStore(539): loaded hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/f1/testWithMapReduce=a108e70c13825ee3f5ff04e1a1a26976-d2c10c710bb74381a077db4f5a8aa70e 2023-02-12 06:02:52,913 INFO [StoreOpener-a108e70c13825ee3f5ff04e1a1a26976-1] regionserver.HStore(310): Store=a108e70c13825ee3f5ff04e1a1a26976/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:52,913 INFO [StoreOpener-a108e70c13825ee3f5ff04e1a1a26976-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a108e70c13825ee3f5ff04e1a1a26976 2023-02-12 06:02:52,914 DEBUG [StoreOpener-a108e70c13825ee3f5ff04e1a1a26976-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/f2 2023-02-12 06:02:52,914 INFO [StoreOpener-a108e70c13825ee3f5ff04e1a1a26976-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a108e70c13825ee3f5ff04e1a1a26976 columnFamilyName f2 2023-02-12 06:02:52,920 DEBUG [StoreOpener-a108e70c13825ee3f5ff04e1a1a26976-1] regionserver.HStore(539): loaded hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/f2/testWithMapReduce=a108e70c13825ee3f5ff04e1a1a26976-9799e4fd82874858a03798f705647159 2023-02-12 06:02:52,920 INFO [StoreOpener-a108e70c13825ee3f5ff04e1a1a26976-1] regionserver.HStore(310): Store=a108e70c13825ee3f5ff04e1a1a26976/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:52,920 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:02:52,920 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened a108e70c13825ee3f5ff04e1a1a26976; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69605337, jitterRate=0.03720034658908844}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:02:52,920 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for a108e70c13825ee3f5ff04e1a1a26976: Writing region info on filesystem at 1676181772902Initializing all the Stores at 1676181772903 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181772903Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181772903Region opened successfully at 1676181772920 (+17 ms) 2023-02-12 06:02:52,949 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing a108e70c13825ee3f5ff04e1a1a26976, disabling compactions & flushes 2023-02-12 06:02:52,949 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976. 2023-02-12 06:02:52,949 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976. 2023-02-12 06:02:52,949 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976. after waiting 0 ms 2023-02-12 06:02:52,949 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976. 2023-02-12 06:02:52,952 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976. 2023-02-12 06:02:52,952 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for a108e70c13825ee3f5ff04e1a1a26976: Waiting for close lock at 1676181772949Disabling compacts and flushes for region at 1676181772949Disabling writes for close at 1676181772949Writing region close event to WAL at 1676181772952 (+3 ms)Closed at 1676181772952 2023-02-12 06:02:52,955 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:52,955 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 06:02:52,962 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:02:52,964 INFO [StoreOpener-9d3a93d53da6320c4938e8cef9659b7c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 9d3a93d53da6320c4938e8cef9659b7c 2023-02-12 06:02:52,965 DEBUG [StoreOpener-9d3a93d53da6320c4938e8cef9659b7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/f1 2023-02-12 06:02:52,966 INFO [StoreOpener-9d3a93d53da6320c4938e8cef9659b7c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9d3a93d53da6320c4938e8cef9659b7c columnFamilyName f1 2023-02-12 06:02:52,974 DEBUG [StoreOpener-9d3a93d53da6320c4938e8cef9659b7c-1] regionserver.HStore(539): loaded hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/f1/testWithMapReduce=9d3a93d53da6320c4938e8cef9659b7c-22b6342600244813bdd116a47900b8b8 2023-02-12 06:02:52,974 INFO [StoreOpener-9d3a93d53da6320c4938e8cef9659b7c-1] regionserver.HStore(310): Store=9d3a93d53da6320c4938e8cef9659b7c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:52,974 INFO [StoreOpener-9d3a93d53da6320c4938e8cef9659b7c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 9d3a93d53da6320c4938e8cef9659b7c 2023-02-12 06:02:52,975 DEBUG [StoreOpener-9d3a93d53da6320c4938e8cef9659b7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/f2 2023-02-12 06:02:52,976 INFO [StoreOpener-9d3a93d53da6320c4938e8cef9659b7c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9d3a93d53da6320c4938e8cef9659b7c columnFamilyName f2 2023-02-12 06:02:52,982 DEBUG [StoreOpener-9d3a93d53da6320c4938e8cef9659b7c-1] regionserver.HStore(539): loaded hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/f2/testWithMapReduce=9d3a93d53da6320c4938e8cef9659b7c-0afb16a97b384baa986ce2acfbf7a883 2023-02-12 06:02:52,982 INFO [StoreOpener-9d3a93d53da6320c4938e8cef9659b7c-1] regionserver.HStore(310): Store=9d3a93d53da6320c4938e8cef9659b7c/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:52,982 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:02:52,982 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 9d3a93d53da6320c4938e8cef9659b7c; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61113480, jitterRate=-0.08933818340301514}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:02:52,983 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 9d3a93d53da6320c4938e8cef9659b7c: Writing region info on filesystem at 1676181772962Initializing all the Stores at 1676181772963 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181772963Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181772964 (+1 ms)Region opened successfully at 1676181772983 (+19 ms) 2023-02-12 06:02:53,011 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 9d3a93d53da6320c4938e8cef9659b7c, disabling compactions & flushes 2023-02-12 06:02:53,011 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c. 2023-02-12 06:02:53,011 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c. 2023-02-12 06:02:53,011 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c. after waiting 0 ms 2023-02-12 06:02:53,011 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c. 2023-02-12 06:02:53,016 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c. 2023-02-12 06:02:53,016 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 9d3a93d53da6320c4938e8cef9659b7c: Waiting for close lock at 1676181773011Disabling compacts and flushes for region at 1676181773011Disabling writes for close at 1676181773011Writing region close event to WAL at 1676181773016 (+5 ms)Closed at 1676181773016 2023-02-12 06:02:53,019 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676181764917.a628981a708add40d0832641d94930a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:53,019 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 06:02:53,022 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:02:53,023 INFO [StoreOpener-a628981a708add40d0832641d94930a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region a628981a708add40d0832641d94930a1 2023-02-12 06:02:53,024 DEBUG [StoreOpener-a628981a708add40d0832641d94930a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/f1 2023-02-12 06:02:53,025 INFO [StoreOpener-a628981a708add40d0832641d94930a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a628981a708add40d0832641d94930a1 columnFamilyName f1 2023-02-12 06:02:53,035 DEBUG [StoreOpener-a628981a708add40d0832641d94930a1-1] regionserver.HStore(539): loaded hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/f1/testWithMapReduce=a628981a708add40d0832641d94930a1-959b2c5834634c4db9efe3ec6c427418 2023-02-12 06:02:53,035 INFO [StoreOpener-a628981a708add40d0832641d94930a1-1] regionserver.HStore(310): Store=a628981a708add40d0832641d94930a1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:53,035 INFO [StoreOpener-a628981a708add40d0832641d94930a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region a628981a708add40d0832641d94930a1 2023-02-12 06:02:53,037 DEBUG [StoreOpener-a628981a708add40d0832641d94930a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/f2 2023-02-12 06:02:53,037 INFO [StoreOpener-a628981a708add40d0832641d94930a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a628981a708add40d0832641d94930a1 columnFamilyName f2 2023-02-12 06:02:53,043 DEBUG [StoreOpener-a628981a708add40d0832641d94930a1-1] regionserver.HStore(539): loaded hdfs://localhost:38185/user/jenkins/test-data/ab33d36d-22c4-0da6-3045-0f39a0423f3c/testWithMapReduceMultiRegion/38fd89e9-332e-4981-ba4a-9bde4950d596/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/f2/testWithMapReduce=a628981a708add40d0832641d94930a1-36901009def44729b60b0ed26d7c9c5e 2023-02-12 06:02:53,043 INFO [StoreOpener-a628981a708add40d0832641d94930a1-1] regionserver.HStore(310): Store=a628981a708add40d0832641d94930a1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:53,043 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:02:53,043 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened a628981a708add40d0832641d94930a1; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62321786, jitterRate=-0.07133302092552185}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:02:53,043 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for a628981a708add40d0832641d94930a1: Writing region info on filesystem at 1676181773022Initializing all the Stores at 1676181773023 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181773023Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181773023Region opened successfully at 1676181773043 (+20 ms) 2023-02-12 06:02:53,100 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing a628981a708add40d0832641d94930a1, disabling compactions & flushes 2023-02-12 06:02:53,100 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676181764917.a628981a708add40d0832641d94930a1. 2023-02-12 06:02:53,100 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676181764917.a628981a708add40d0832641d94930a1. 2023-02-12 06:02:53,100 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676181764917.a628981a708add40d0832641d94930a1. after waiting 0 ms 2023-02-12 06:02:53,100 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676181764917.a628981a708add40d0832641d94930a1. 2023-02-12 06:02:53,103 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676181764917.a628981a708add40d0832641d94930a1. 2023-02-12 06:02:53,103 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for a628981a708add40d0832641d94930a1: Waiting for close lock at 1676181773100Disabling compacts and flushes for region at 1676181773100Disabling writes for close at 1676181773100Writing region close event to WAL at 1676181773103 (+3 ms)Closed at 1676181773103 2023-02-12 06:02:54,195 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceMultiRegion" 2023-02-12 06:02:54,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-12 06:02:54,202 INFO [Listener at localhost/44119] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-12 06:02:54,202 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-12 06:02:54,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-12 06:02:54,213 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676181774212"}]},"ts":"1676181774212"} 2023-02-12 06:02:54,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-12 06:02:54,215 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-12 06:02:54,217 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-12 06:02:54,220 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=8179ea2f8e67c4dfba2d173b7540832f, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=318c101741f622a7a64c9c89324799b2, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=a108e70c13825ee3f5ff04e1a1a26976, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=a628981a708add40d0832641d94930a1, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ede1a2ead4c611c9c8e6e77d11191a1d, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=9d3a93d53da6320c4938e8cef9659b7c, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=305521ef65605b0ecbb78cb79cda5d7e, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=5f4fabd8d4e0ff0b3e3d8eab4c9899ca, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ce3f693b6332926321d72525ad1f0592, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e5810b3e54afabb05e70eb1e55b617c0, UNASSIGN}] 2023-02-12 06:02:54,223 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ce3f693b6332926321d72525ad1f0592, UNASSIGN 2023-02-12 06:02:54,223 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=5f4fabd8d4e0ff0b3e3d8eab4c9899ca, UNASSIGN 2023-02-12 06:02:54,223 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=305521ef65605b0ecbb78cb79cda5d7e, UNASSIGN 2023-02-12 06:02:54,223 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e5810b3e54afabb05e70eb1e55b617c0, UNASSIGN 2023-02-12 06:02:54,223 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=9d3a93d53da6320c4938e8cef9659b7c, UNASSIGN 2023-02-12 06:02:54,224 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=ce3f693b6332926321d72525ad1f0592, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:54,224 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=305521ef65605b0ecbb78cb79cda5d7e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:54,224 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=5f4fabd8d4e0ff0b3e3d8eab4c9899ca, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:54,224 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181774224"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181774224"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181774224"}]},"ts":"1676181774224"} 2023-02-12 06:02:54,224 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=9d3a93d53da6320c4938e8cef9659b7c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:54,224 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=e5810b3e54afabb05e70eb1e55b617c0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:54,224 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181774224"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181774224"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181774224"}]},"ts":"1676181774224"} 2023-02-12 06:02:54,225 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676181774224"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181774224"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181774224"}]},"ts":"1676181774224"} 2023-02-12 06:02:54,224 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181774224"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181774224"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181774224"}]},"ts":"1676181774224"} 2023-02-12 06:02:54,225 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181774224"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181774224"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181774224"}]},"ts":"1676181774224"} 2023-02-12 06:02:54,227 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=42, state=RUNNABLE; CloseRegionProcedure ce3f693b6332926321d72525ad1f0592, server=jenkins-hbase4.apache.org,43903,1676181760972}] 2023-02-12 06:02:54,227 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=41, state=RUNNABLE; CloseRegionProcedure 5f4fabd8d4e0ff0b3e3d8eab4c9899ca, server=jenkins-hbase4.apache.org,33981,1676181760918}] 2023-02-12 06:02:54,229 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; CloseRegionProcedure e5810b3e54afabb05e70eb1e55b617c0, server=jenkins-hbase4.apache.org,33981,1676181760918}] 2023-02-12 06:02:54,230 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=40, state=RUNNABLE; CloseRegionProcedure 305521ef65605b0ecbb78cb79cda5d7e, server=jenkins-hbase4.apache.org,43903,1676181760972}] 2023-02-12 06:02:54,231 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=39, state=RUNNABLE; CloseRegionProcedure 9d3a93d53da6320c4938e8cef9659b7c, server=jenkins-hbase4.apache.org,43903,1676181760972}] 2023-02-12 06:02:54,237 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=ede1a2ead4c611c9c8e6e77d11191a1d, UNASSIGN 2023-02-12 06:02:54,237 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=a628981a708add40d0832641d94930a1, UNASSIGN 2023-02-12 06:02:54,238 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=a108e70c13825ee3f5ff04e1a1a26976, UNASSIGN 2023-02-12 06:02:54,238 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=318c101741f622a7a64c9c89324799b2, UNASSIGN 2023-02-12 06:02:54,239 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=8179ea2f8e67c4dfba2d173b7540832f, UNASSIGN 2023-02-12 06:02:54,239 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=ede1a2ead4c611c9c8e6e77d11191a1d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:54,239 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181774239"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181774239"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181774239"}]},"ts":"1676181774239"} 2023-02-12 06:02:54,239 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=a628981a708add40d0832641d94930a1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:54,239 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676181764917.a628981a708add40d0832641d94930a1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181774239"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181774239"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181774239"}]},"ts":"1676181774239"} 2023-02-12 06:02:54,240 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=a108e70c13825ee3f5ff04e1a1a26976, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:54,240 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=318c101741f622a7a64c9c89324799b2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:54,241 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181774240"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181774240"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181774240"}]},"ts":"1676181774240"} 2023-02-12 06:02:54,241 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181774240"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181774240"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181774240"}]},"ts":"1676181774240"} 2023-02-12 06:02:54,241 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=38, state=RUNNABLE; CloseRegionProcedure ede1a2ead4c611c9c8e6e77d11191a1d, server=jenkins-hbase4.apache.org,33981,1676181760918}] 2023-02-12 06:02:54,242 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=8179ea2f8e67c4dfba2d173b7540832f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:54,242 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676181774242"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181774242"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181774242"}]},"ts":"1676181774242"} 2023-02-12 06:02:54,246 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=37, state=RUNNABLE; CloseRegionProcedure a628981a708add40d0832641d94930a1, server=jenkins-hbase4.apache.org,33981,1676181760918}] 2023-02-12 06:02:54,268 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=35, state=RUNNABLE; CloseRegionProcedure 318c101741f622a7a64c9c89324799b2, server=jenkins-hbase4.apache.org,43903,1676181760972}] 2023-02-12 06:02:54,268 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=36, state=RUNNABLE; CloseRegionProcedure a108e70c13825ee3f5ff04e1a1a26976, server=jenkins-hbase4.apache.org,33981,1676181760918}] 2023-02-12 06:02:54,269 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=34, state=RUNNABLE; CloseRegionProcedure 8179ea2f8e67c4dfba2d173b7540832f, server=jenkins-hbase4.apache.org,43903,1676181760972}] 2023-02-12 06:02:54,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-12 06:02:54,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 9d3a93d53da6320c4938e8cef9659b7c 2023-02-12 06:02:54,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 5f4fabd8d4e0ff0b3e3d8eab4c9899ca 2023-02-12 06:02:54,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 9d3a93d53da6320c4938e8cef9659b7c, disabling compactions & flushes 2023-02-12 06:02:54,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5f4fabd8d4e0ff0b3e3d8eab4c9899ca, disabling compactions & flushes 2023-02-12 06:02:54,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c. 2023-02-12 06:02:54,389 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca. 2023-02-12 06:02:54,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c. 2023-02-12 06:02:54,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca. 2023-02-12 06:02:54,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c. after waiting 0 ms 2023-02-12 06:02:54,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c. 2023-02-12 06:02:54,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca. after waiting 0 ms 2023-02-12 06:02:54,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca. 2023-02-12 06:02:54,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 06:02:54,415 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c. 2023-02-12 06:02:54,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 9d3a93d53da6320c4938e8cef9659b7c: Waiting for close lock at 1676181774389Running coprocessor pre-close hooks at 1676181774389Disabling compacts and flushes for region at 1676181774389Disabling writes for close at 1676181774389Writing region close event to WAL at 1676181774402 (+13 ms)Running coprocessor post-close hooks at 1676181774414 (+12 ms)Closed at 1676181774415 (+1 ms) 2023-02-12 06:02:54,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 06:02:54,418 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 9d3a93d53da6320c4938e8cef9659b7c 2023-02-12 06:02:54,419 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close ce3f693b6332926321d72525ad1f0592 2023-02-12 06:02:54,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ce3f693b6332926321d72525ad1f0592, disabling compactions & flushes 2023-02-12 06:02:54,419 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592. 2023-02-12 06:02:54,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592. 2023-02-12 06:02:54,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592. after waiting 0 ms 2023-02-12 06:02:54,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592. 2023-02-12 06:02:54,419 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=9d3a93d53da6320c4938e8cef9659b7c, regionState=CLOSED 2023-02-12 06:02:54,419 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181774419"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181774419"}]},"ts":"1676181774419"} 2023-02-12 06:02:54,424 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=39 2023-02-12 06:02:54,424 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=39, state=SUCCESS; CloseRegionProcedure 9d3a93d53da6320c4938e8cef9659b7c, server=jenkins-hbase4.apache.org,43903,1676181760972 in 191 msec 2023-02-12 06:02:54,427 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=9d3a93d53da6320c4938e8cef9659b7c, UNASSIGN in 206 msec 2023-02-12 06:02:54,436 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca. 2023-02-12 06:02:54,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5f4fabd8d4e0ff0b3e3d8eab4c9899ca: Waiting for close lock at 1676181774389Running coprocessor pre-close hooks at 1676181774389Disabling compacts and flushes for region at 1676181774389Disabling writes for close at 1676181774389Writing region close event to WAL at 1676181774404 (+15 ms)Running coprocessor post-close hooks at 1676181774421 (+17 ms)Closed at 1676181774436 (+15 ms) 2023-02-12 06:02:54,444 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 5f4fabd8d4e0ff0b3e3d8eab4c9899ca 2023-02-12 06:02:54,444 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close a108e70c13825ee3f5ff04e1a1a26976 2023-02-12 06:02:54,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a108e70c13825ee3f5ff04e1a1a26976, disabling compactions & flushes 2023-02-12 06:02:54,444 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976. 2023-02-12 06:02:54,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976. 2023-02-12 06:02:54,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976. after waiting 0 ms 2023-02-12 06:02:54,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976. 2023-02-12 06:02:54,449 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=5f4fabd8d4e0ff0b3e3d8eab4c9899ca, regionState=CLOSED 2023-02-12 06:02:54,449 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181774449"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181774449"}]},"ts":"1676181774449"} 2023-02-12 06:02:54,457 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=41 2023-02-12 06:02:54,457 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=41, state=SUCCESS; CloseRegionProcedure 5f4fabd8d4e0ff0b3e3d8eab4c9899ca, server=jenkins-hbase4.apache.org,33981,1676181760918 in 227 msec 2023-02-12 06:02:54,459 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5f4fabd8d4e0ff0b3e3d8eab4c9899ca, UNASSIGN in 239 msec 2023-02-12 06:02:54,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 06:02:54,481 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592. 2023-02-12 06:02:54,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ce3f693b6332926321d72525ad1f0592: Waiting for close lock at 1676181774419Running coprocessor pre-close hooks at 1676181774419Disabling compacts and flushes for region at 1676181774419Disabling writes for close at 1676181774419Writing region close event to WAL at 1676181774441 (+22 ms)Running coprocessor post-close hooks at 1676181774467 (+26 ms)Closed at 1676181774481 (+14 ms) 2023-02-12 06:02:54,493 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed ce3f693b6332926321d72525ad1f0592 2023-02-12 06:02:54,493 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 318c101741f622a7a64c9c89324799b2 2023-02-12 06:02:54,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 318c101741f622a7a64c9c89324799b2, disabling compactions & flushes 2023-02-12 06:02:54,493 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2. 2023-02-12 06:02:54,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2. 2023-02-12 06:02:54,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2. after waiting 0 ms 2023-02-12 06:02:54,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2. 2023-02-12 06:02:54,494 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=ce3f693b6332926321d72525ad1f0592, regionState=CLOSED 2023-02-12 06:02:54,494 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181774494"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181774494"}]},"ts":"1676181774494"} 2023-02-12 06:02:54,501 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-02-12 06:02:54,501 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; CloseRegionProcedure ce3f693b6332926321d72525ad1f0592, server=jenkins-hbase4.apache.org,43903,1676181760972 in 271 msec 2023-02-12 06:02:54,503 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ce3f693b6332926321d72525ad1f0592, UNASSIGN in 281 msec 2023-02-12 06:02:54,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 06:02:54,520 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976. 2023-02-12 06:02:54,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a108e70c13825ee3f5ff04e1a1a26976: Waiting for close lock at 1676181774444Running coprocessor pre-close hooks at 1676181774444Disabling compacts and flushes for region at 1676181774444Disabling writes for close at 1676181774444Writing region close event to WAL at 1676181774485 (+41 ms)Running coprocessor post-close hooks at 1676181774517 (+32 ms)Closed at 1676181774520 (+3 ms) 2023-02-12 06:02:54,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-12 06:02:54,524 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed a108e70c13825ee3f5ff04e1a1a26976 2023-02-12 06:02:54,524 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close a628981a708add40d0832641d94930a1 2023-02-12 06:02:54,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a628981a708add40d0832641d94930a1, disabling compactions & flushes 2023-02-12 06:02:54,525 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676181764917.a628981a708add40d0832641d94930a1. 2023-02-12 06:02:54,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676181764917.a628981a708add40d0832641d94930a1. 2023-02-12 06:02:54,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676181764917.a628981a708add40d0832641d94930a1. after waiting 0 ms 2023-02-12 06:02:54,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676181764917.a628981a708add40d0832641d94930a1. 2023-02-12 06:02:54,526 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=a108e70c13825ee3f5ff04e1a1a26976, regionState=CLOSED 2023-02-12 06:02:54,526 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181774526"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181774526"}]},"ts":"1676181774526"} 2023-02-12 06:02:54,533 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=36 2023-02-12 06:02:54,533 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=36, state=SUCCESS; CloseRegionProcedure a108e70c13825ee3f5ff04e1a1a26976, server=jenkins-hbase4.apache.org,33981,1676181760918 in 261 msec 2023-02-12 06:02:54,535 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a108e70c13825ee3f5ff04e1a1a26976, UNASSIGN in 315 msec 2023-02-12 06:02:54,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 06:02:54,592 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2. 2023-02-12 06:02:54,593 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 318c101741f622a7a64c9c89324799b2: Waiting for close lock at 1676181774493Running coprocessor pre-close hooks at 1676181774493Disabling compacts and flushes for region at 1676181774493Disabling writes for close at 1676181774493Writing region close event to WAL at 1676181774554 (+61 ms)Running coprocessor post-close hooks at 1676181774574 (+20 ms)Closed at 1676181774592 (+18 ms) 2023-02-12 06:02:54,595 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 318c101741f622a7a64c9c89324799b2 2023-02-12 06:02:54,595 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 305521ef65605b0ecbb78cb79cda5d7e 2023-02-12 06:02:54,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 305521ef65605b0ecbb78cb79cda5d7e, disabling compactions & flushes 2023-02-12 06:02:54,595 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e. 2023-02-12 06:02:54,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e. 2023-02-12 06:02:54,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e. after waiting 0 ms 2023-02-12 06:02:54,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e. 2023-02-12 06:02:54,596 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=318c101741f622a7a64c9c89324799b2, regionState=CLOSED 2023-02-12 06:02:54,596 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181774596"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181774596"}]},"ts":"1676181774596"} 2023-02-12 06:02:54,602 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=35 2023-02-12 06:02:54,602 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=35, state=SUCCESS; CloseRegionProcedure 318c101741f622a7a64c9c89324799b2, server=jenkins-hbase4.apache.org,43903,1676181760972 in 331 msec 2023-02-12 06:02:54,604 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=318c101741f622a7a64c9c89324799b2, UNASSIGN in 384 msec 2023-02-12 06:02:54,614 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 06:02:54,617 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676181764917.a628981a708add40d0832641d94930a1. 2023-02-12 06:02:54,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a628981a708add40d0832641d94930a1: Waiting for close lock at 1676181774525Running coprocessor pre-close hooks at 1676181774525Disabling compacts and flushes for region at 1676181774525Disabling writes for close at 1676181774525Writing region close event to WAL at 1676181774593 (+68 ms)Running coprocessor post-close hooks at 1676181774614 (+21 ms)Closed at 1676181774617 (+3 ms) 2023-02-12 06:02:54,620 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed a628981a708add40d0832641d94930a1 2023-02-12 06:02:54,620 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e5810b3e54afabb05e70eb1e55b617c0 2023-02-12 06:02:54,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e5810b3e54afabb05e70eb1e55b617c0, disabling compactions & flushes 2023-02-12 06:02:54,620 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0. 2023-02-12 06:02:54,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0. 2023-02-12 06:02:54,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0. after waiting 0 ms 2023-02-12 06:02:54,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0. 2023-02-12 06:02:54,620 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=a628981a708add40d0832641d94930a1, regionState=CLOSED 2023-02-12 06:02:54,621 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676181764917.a628981a708add40d0832641d94930a1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181774620"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181774620"}]},"ts":"1676181774620"} 2023-02-12 06:02:54,625 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=37 2023-02-12 06:02:54,625 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=37, state=SUCCESS; CloseRegionProcedure a628981a708add40d0832641d94930a1, server=jenkins-hbase4.apache.org,33981,1676181760918 in 377 msec 2023-02-12 06:02:54,628 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=a628981a708add40d0832641d94930a1, UNASSIGN in 407 msec 2023-02-12 06:02:54,644 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 06:02:54,646 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e. 2023-02-12 06:02:54,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 305521ef65605b0ecbb78cb79cda5d7e: Waiting for close lock at 1676181774595Running coprocessor pre-close hooks at 1676181774595Disabling compacts and flushes for region at 1676181774595Disabling writes for close at 1676181774595Writing region close event to WAL at 1676181774632 (+37 ms)Running coprocessor post-close hooks at 1676181774645 (+13 ms)Closed at 1676181774646 (+1 ms) 2023-02-12 06:02:54,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/e5810b3e54afabb05e70eb1e55b617c0/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-12 06:02:54,649 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0. 2023-02-12 06:02:54,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e5810b3e54afabb05e70eb1e55b617c0: Waiting for close lock at 1676181774620Running coprocessor pre-close hooks at 1676181774620Disabling compacts and flushes for region at 1676181774620Disabling writes for close at 1676181774620Writing region close event to WAL at 1676181774632 (+12 ms)Running coprocessor post-close hooks at 1676181774648 (+16 ms)Closed at 1676181774649 (+1 ms) 2023-02-12 06:02:54,650 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 305521ef65605b0ecbb78cb79cda5d7e 2023-02-12 06:02:54,650 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 8179ea2f8e67c4dfba2d173b7540832f 2023-02-12 06:02:54,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8179ea2f8e67c4dfba2d173b7540832f, disabling compactions & flushes 2023-02-12 06:02:54,650 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f. 2023-02-12 06:02:54,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f. 2023-02-12 06:02:54,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f. after waiting 0 ms 2023-02-12 06:02:54,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f. 2023-02-12 06:02:54,652 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=305521ef65605b0ecbb78cb79cda5d7e, regionState=CLOSED 2023-02-12 06:02:54,652 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181774651"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181774651"}]},"ts":"1676181774651"} 2023-02-12 06:02:54,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e5810b3e54afabb05e70eb1e55b617c0 2023-02-12 06:02:54,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close ede1a2ead4c611c9c8e6e77d11191a1d 2023-02-12 06:02:54,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ede1a2ead4c611c9c8e6e77d11191a1d, disabling compactions & flushes 2023-02-12 06:02:54,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d. 2023-02-12 06:02:54,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d. 2023-02-12 06:02:54,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d. after waiting 0 ms 2023-02-12 06:02:54,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d. 2023-02-12 06:02:54,653 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=e5810b3e54afabb05e70eb1e55b617c0, regionState=CLOSED 2023-02-12 06:02:54,653 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676181774653"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181774653"}]},"ts":"1676181774653"} 2023-02-12 06:02:54,657 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=40 2023-02-12 06:02:54,657 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=40, state=SUCCESS; CloseRegionProcedure 305521ef65605b0ecbb78cb79cda5d7e, server=jenkins-hbase4.apache.org,43903,1676181760972 in 424 msec 2023-02-12 06:02:54,658 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-02-12 06:02:54,658 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; CloseRegionProcedure e5810b3e54afabb05e70eb1e55b617c0, server=jenkins-hbase4.apache.org,33981,1676181760918 in 426 msec 2023-02-12 06:02:54,659 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=305521ef65605b0ecbb78cb79cda5d7e, UNASSIGN in 439 msec 2023-02-12 06:02:54,660 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e5810b3e54afabb05e70eb1e55b617c0, UNASSIGN in 438 msec 2023-02-12 06:02:54,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/8179ea2f8e67c4dfba2d173b7540832f/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-12 06:02:54,676 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f. 2023-02-12 06:02:54,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8179ea2f8e67c4dfba2d173b7540832f: Waiting for close lock at 1676181774650Running coprocessor pre-close hooks at 1676181774650Disabling compacts and flushes for region at 1676181774650Disabling writes for close at 1676181774650Writing region close event to WAL at 1676181774663 (+13 ms)Running coprocessor post-close hooks at 1676181774673 (+10 ms)Closed at 1676181774676 (+3 ms) 2023-02-12 06:02:54,679 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 8179ea2f8e67c4dfba2d173b7540832f 2023-02-12 06:02:54,680 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=8179ea2f8e67c4dfba2d173b7540832f, regionState=CLOSED 2023-02-12 06:02:54,680 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676181774680"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181774680"}]},"ts":"1676181774680"} 2023-02-12 06:02:54,685 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=34 2023-02-12 06:02:54,685 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=34, state=SUCCESS; CloseRegionProcedure 8179ea2f8e67c4dfba2d173b7540832f, server=jenkins-hbase4.apache.org,43903,1676181760972 in 413 msec 2023-02-12 06:02:54,687 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=8179ea2f8e67c4dfba2d173b7540832f, UNASSIGN in 467 msec 2023-02-12 06:02:54,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 06:02:54,695 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d. 2023-02-12 06:02:54,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ede1a2ead4c611c9c8e6e77d11191a1d: Waiting for close lock at 1676181774652Running coprocessor pre-close hooks at 1676181774652Disabling compacts and flushes for region at 1676181774652Disabling writes for close at 1676181774652Writing region close event to WAL at 1676181774690 (+38 ms)Running coprocessor post-close hooks at 1676181774695 (+5 ms)Closed at 1676181774695 2023-02-12 06:02:54,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed ede1a2ead4c611c9c8e6e77d11191a1d 2023-02-12 06:02:54,698 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=ede1a2ead4c611c9c8e6e77d11191a1d, regionState=CLOSED 2023-02-12 06:02:54,698 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181774698"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181774698"}]},"ts":"1676181774698"} 2023-02-12 06:02:54,702 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=38 2023-02-12 06:02:54,702 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=38, state=SUCCESS; CloseRegionProcedure ede1a2ead4c611c9c8e6e77d11191a1d, server=jenkins-hbase4.apache.org,33981,1676181760918 in 459 msec 2023-02-12 06:02:54,704 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=33 2023-02-12 06:02:54,704 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ede1a2ead4c611c9c8e6e77d11191a1d, UNASSIGN in 484 msec 2023-02-12 06:02:54,705 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676181774705"}]},"ts":"1676181774705"} 2023-02-12 06:02:54,707 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-12 06:02:54,709 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-12 06:02:54,712 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 506 msec 2023-02-12 06:02:54,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-12 06:02:54,825 INFO [Listener at localhost/44119] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-12 06:02:54,830 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-12 06:02:54,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-12 06:02:54,841 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 06:02:54,843 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 06:02:54,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-12 06:02:54,861 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/8179ea2f8e67c4dfba2d173b7540832f 2023-02-12 06:02:54,861 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2 2023-02-12 06:02:54,861 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1 2023-02-12 06:02:54,861 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c 2023-02-12 06:02:54,861 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e 2023-02-12 06:02:54,861 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca 2023-02-12 06:02:54,861 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d 2023-02-12 06:02:54,861 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976 2023-02-12 06:02:54,870 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/f1, FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/f2, FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/recovered.edits] 2023-02-12 06:02:54,870 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/8179ea2f8e67c4dfba2d173b7540832f/f1, FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/8179ea2f8e67c4dfba2d173b7540832f/f2, FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/8179ea2f8e67c4dfba2d173b7540832f/recovered.edits] 2023-02-12 06:02:54,870 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/f1, FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/f2, FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/recovered.edits] 2023-02-12 06:02:54,871 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/f1, FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/f2, FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/recovered.edits] 2023-02-12 06:02:54,871 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/f1, FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/f2, FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/recovered.edits] 2023-02-12 06:02:54,872 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/f1, FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/f2, FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/recovered.edits] 2023-02-12 06:02:54,872 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/f1, FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/f2, FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/recovered.edits] 2023-02-12 06:02:54,872 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/f1, FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/f2, FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/recovered.edits] 2023-02-12 06:02:54,889 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/f1/afd7b2567a614cf09677de928978d96f to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/f1/afd7b2567a614cf09677de928978d96f 2023-02-12 06:02:54,893 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/f1/54ecab56e628413c8b216dcc356867ca to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/f1/54ecab56e628413c8b216dcc356867ca 2023-02-12 06:02:54,894 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/f1/22b6342600244813bdd116a47900b8b8 to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/f1/22b6342600244813bdd116a47900b8b8 2023-02-12 06:02:54,894 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/f1/10c52d63b5c84360a2eb7c9ed8a036bf to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/f1/10c52d63b5c84360a2eb7c9ed8a036bf 2023-02-12 06:02:54,894 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/f1/5bbfd03016ad40e9a47aa343963a9932 to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/f1/5bbfd03016ad40e9a47aa343963a9932 2023-02-12 06:02:54,895 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/f1/c1e8de00e2d242c588e62e77ab8d267b to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/f1/c1e8de00e2d242c588e62e77ab8d267b 2023-02-12 06:02:54,897 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/f1/04db54a59dd947d69d87f408df68b233 to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/f1/04db54a59dd947d69d87f408df68b233 2023-02-12 06:02:54,898 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/f1/959b2c5834634c4db9efe3ec6c427418 to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/f1/959b2c5834634c4db9efe3ec6c427418 2023-02-12 06:02:54,899 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/f1/a8f2912ca4ab44a09549a0262d4657ac to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/f1/a8f2912ca4ab44a09549a0262d4657ac 2023-02-12 06:02:54,900 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/f1/690e533ffd2f4c72abc6eddf9f12a2c3 to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/f1/690e533ffd2f4c72abc6eddf9f12a2c3 2023-02-12 06:02:54,900 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/f1/5e373fe3670d4f07bbc4fbcd94739b17 to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/f1/5e373fe3670d4f07bbc4fbcd94739b17 2023-02-12 06:02:54,900 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/f1/d2c10c710bb74381a077db4f5a8aa70e to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/f1/d2c10c710bb74381a077db4f5a8aa70e 2023-02-12 06:02:54,902 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/8179ea2f8e67c4dfba2d173b7540832f/recovered.edits/6.seqid to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/8179ea2f8e67c4dfba2d173b7540832f/recovered.edits/6.seqid 2023-02-12 06:02:54,905 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/f1/726526fb49e3429ab59ab8a28c8f34f9 to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/f1/726526fb49e3429ab59ab8a28c8f34f9 2023-02-12 06:02:54,905 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/8179ea2f8e67c4dfba2d173b7540832f 2023-02-12 06:02:54,905 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592 2023-02-12 06:02:54,907 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/f1/b350aed70b8f4ccfb5050d009d1773b0 to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/f1/b350aed70b8f4ccfb5050d009d1773b0 2023-02-12 06:02:54,911 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/f2/04019d7c88ba4a3f96feee1fa33432e5 to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/f2/04019d7c88ba4a3f96feee1fa33432e5 2023-02-12 06:02:54,912 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/f2/656dd20d583e4baea788f9aa6ac83e69 to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/f2/656dd20d583e4baea788f9aa6ac83e69 2023-02-12 06:02:54,913 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/f2/921aedb34001438ba763c82be3f36abb to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/f2/921aedb34001438ba763c82be3f36abb 2023-02-12 06:02:54,914 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/f2/0afb16a97b384baa986ce2acfbf7a883 to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/f2/0afb16a97b384baa986ce2acfbf7a883 2023-02-12 06:02:54,914 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/f2/308b8b70976f47239b04565976d2edf6 to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/f2/308b8b70976f47239b04565976d2edf6 2023-02-12 06:02:54,914 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/f1, FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/f2, FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/recovered.edits] 2023-02-12 06:02:54,917 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/f2/ace8c1b602bd49ec82074e8239030b38 to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/f2/ace8c1b602bd49ec82074e8239030b38 2023-02-12 06:02:54,917 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/f2/082b13d4196f4b51bcefd14687a1f46d to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/f2/082b13d4196f4b51bcefd14687a1f46d 2023-02-12 06:02:54,917 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/f2/9799e4fd82874858a03798f705647159 to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/f2/9799e4fd82874858a03798f705647159 2023-02-12 06:02:54,918 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/f2/ec3b46a9acd74245b3888084b2815d64 to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/f2/ec3b46a9acd74245b3888084b2815d64 2023-02-12 06:02:54,919 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/f2/c7c991ed20e142b7b9c25fa14ef8e8c1 to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/f2/c7c991ed20e142b7b9c25fa14ef8e8c1 2023-02-12 06:02:54,921 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/f2/83788949b6254215ba0dfc3c1e64401e to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/f2/83788949b6254215ba0dfc3c1e64401e 2023-02-12 06:02:54,921 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/f2/36901009def44729b60b0ed26d7c9c5e to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/f2/36901009def44729b60b0ed26d7c9c5e 2023-02-12 06:02:54,924 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/f2/7b2505fc33164624aca97310355e9c2b to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/f2/7b2505fc33164624aca97310355e9c2b 2023-02-12 06:02:54,929 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/f2/f41cff29818f4a8b89e99b00923829cf to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/f2/f41cff29818f4a8b89e99b00923829cf 2023-02-12 06:02:54,931 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/f1/496d2656ee684894a3923bbb24127753 to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/f1/496d2656ee684894a3923bbb24127753 2023-02-12 06:02:54,933 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/recovered.edits/12.seqid to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d/recovered.edits/12.seqid 2023-02-12 06:02:54,933 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/recovered.edits/12.seqid to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976/recovered.edits/12.seqid 2023-02-12 06:02:54,933 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/recovered.edits/12.seqid to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2/recovered.edits/12.seqid 2023-02-12 06:02:54,934 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/a108e70c13825ee3f5ff04e1a1a26976 2023-02-12 06:02:54,934 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/e5810b3e54afabb05e70eb1e55b617c0 2023-02-12 06:02:54,935 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/ede1a2ead4c611c9c8e6e77d11191a1d 2023-02-12 06:02:54,936 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/318c101741f622a7a64c9c89324799b2 2023-02-12 06:02:54,938 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/f1/aeaa0bf9609149ed89911f7647bf4f58 to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/f1/aeaa0bf9609149ed89911f7647bf4f58 2023-02-12 06:02:54,938 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/recovered.edits/12.seqid to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca/recovered.edits/12.seqid 2023-02-12 06:02:54,939 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/recovered.edits/12.seqid to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c/recovered.edits/12.seqid 2023-02-12 06:02:54,941 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/5f4fabd8d4e0ff0b3e3d8eab4c9899ca 2023-02-12 06:02:54,941 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/recovered.edits/12.seqid to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e/recovered.edits/12.seqid 2023-02-12 06:02:54,941 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/9d3a93d53da6320c4938e8cef9659b7c 2023-02-12 06:02:54,941 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/e5810b3e54afabb05e70eb1e55b617c0/f1, FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/e5810b3e54afabb05e70eb1e55b617c0/f2, FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/e5810b3e54afabb05e70eb1e55b617c0/recovered.edits] 2023-02-12 06:02:54,942 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/305521ef65605b0ecbb78cb79cda5d7e 2023-02-12 06:02:54,943 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/recovered.edits/12.seqid to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1/recovered.edits/12.seqid 2023-02-12 06:02:54,945 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/a628981a708add40d0832641d94930a1 2023-02-12 06:02:54,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-12 06:02:54,947 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/f2/237ca5f2b636422da283e230b5e9d3de to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/f2/237ca5f2b636422da283e230b5e9d3de 2023-02-12 06:02:54,950 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/f2/ff08c997325a403e90c32b594b2bf7bf to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/f2/ff08c997325a403e90c32b594b2bf7bf 2023-02-12 06:02:54,953 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/e5810b3e54afabb05e70eb1e55b617c0/recovered.edits/6.seqid to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/e5810b3e54afabb05e70eb1e55b617c0/recovered.edits/6.seqid 2023-02-12 06:02:54,953 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/e5810b3e54afabb05e70eb1e55b617c0 2023-02-12 06:02:54,954 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/recovered.edits/12.seqid to hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/archive/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592/recovered.edits/12.seqid 2023-02-12 06:02:54,956 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/.tmp/data/default/testWithMapReduce/ce3f693b6332926321d72525ad1f0592 2023-02-12 06:02:54,956 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-12 06:02:54,959 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 06:02:55,001 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-12 06:02:55,005 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-12 06:02:55,007 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 06:02:55,007 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-12 06:02:55,007 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676181775007"}]},"ts":"9223372036854775807"} 2023-02-12 06:02:55,007 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676181775007"}]},"ts":"9223372036854775807"} 2023-02-12 06:02:55,007 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676181775007"}]},"ts":"9223372036854775807"} 2023-02-12 06:02:55,007 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1676181764917.a628981a708add40d0832641d94930a1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676181775007"}]},"ts":"9223372036854775807"} 2023-02-12 06:02:55,007 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676181775007"}]},"ts":"9223372036854775807"} 2023-02-12 06:02:55,007 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676181775007"}]},"ts":"9223372036854775807"} 2023-02-12 06:02:55,008 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676181775007"}]},"ts":"9223372036854775807"} 2023-02-12 06:02:55,008 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676181775007"}]},"ts":"9223372036854775807"} 2023-02-12 06:02:55,008 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676181775007"}]},"ts":"9223372036854775807"} 2023-02-12 06:02:55,008 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676181775007"}]},"ts":"9223372036854775807"} 2023-02-12 06:02:55,012 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-12 06:02:55,012 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8179ea2f8e67c4dfba2d173b7540832f, NAME => 'testWithMapReduce,,1676181764917.8179ea2f8e67c4dfba2d173b7540832f.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => 318c101741f622a7a64c9c89324799b2, NAME => 'testWithMapReduce,aaa,1676181764917.318c101741f622a7a64c9c89324799b2.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => a108e70c13825ee3f5ff04e1a1a26976, NAME => 'testWithMapReduce,d\x84\x84,1676181764917.a108e70c13825ee3f5ff04e1a1a26976.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => a628981a708add40d0832641d94930a1, NAME => 'testWithMapReduce,g\xA7\xA7,1676181764917.a628981a708add40d0832641d94930a1.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => ede1a2ead4c611c9c8e6e77d11191a1d, NAME => 'testWithMapReduce,j\xCA\xCA,1676181764917.ede1a2ead4c611c9c8e6e77d11191a1d.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 9d3a93d53da6320c4938e8cef9659b7c, NAME => 'testWithMapReduce,m\xED\xED,1676181764917.9d3a93d53da6320c4938e8cef9659b7c.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 305521ef65605b0ecbb78cb79cda5d7e, NAME => 'testWithMapReduce,q\x11\x10,1676181764917.305521ef65605b0ecbb78cb79cda5d7e.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 5f4fabd8d4e0ff0b3e3d8eab4c9899ca, NAME => 'testWithMapReduce,t43,1676181764917.5f4fabd8d4e0ff0b3e3d8eab4c9899ca.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => ce3f693b6332926321d72525ad1f0592, NAME => 'testWithMapReduce,wWV,1676181764917.ce3f693b6332926321d72525ad1f0592.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => e5810b3e54afabb05e70eb1e55b617c0, NAME => 'testWithMapReduce,zz{,1676181764917.e5810b3e54afabb05e70eb1e55b617c0.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-12 06:02:55,012 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-12 06:02:55,012 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676181775012"}]},"ts":"9223372036854775807"} 2023-02-12 06:02:55,014 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-12 06:02:55,017 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 06:02:55,018 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 185 msec 2023-02-12 06:02:55,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-12 06:02:55,149 INFO [Listener at localhost/44119] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-12 06:02:55,149 INFO [Listener at localhost/44119] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-12 06:02:55,149 INFO [Listener at localhost/44119] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 06:02:55,150 DEBUG [Listener at localhost/44119] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4104c894 to 127.0.0.1:56793 2023-02-12 06:02:55,150 DEBUG [Listener at localhost/44119] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:02:55,150 DEBUG [Listener at localhost/44119] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-12 06:02:55,150 DEBUG [Listener at localhost/44119] util.JVMClusterUtil(257): Found active master hash=68633774, stopped=false 2023-02-12 06:02:55,150 INFO [Listener at localhost/44119] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40371,1676181759683 2023-02-12 06:02:55,154 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): regionserver:33981-0x100471fcd120001, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 06:02:55,154 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 06:02:55,154 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:02:55,154 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): regionserver:43903-0x100471fcd120002, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 06:02:55,154 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:02:55,155 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33981-0x100471fcd120001, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:02:55,154 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43903-0x100471fcd120002, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:02:55,156 INFO [Listener at localhost/44119] procedure2.ProcedureExecutor(629): Stopping 2023-02-12 06:02:55,164 DEBUG [Listener at localhost/44119] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5955b6aa to 127.0.0.1:56793 2023-02-12 06:02:55,164 DEBUG [Listener at localhost/44119] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:02:55,164 INFO [Listener at localhost/44119] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,33981,1676181760918' ***** 2023-02-12 06:02:55,164 INFO [Listener at localhost/44119] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 06:02:55,165 INFO [Listener at localhost/44119] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43903,1676181760972' ***** 2023-02-12 06:02:55,165 INFO [Listener at localhost/44119] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 06:02:55,165 INFO [RS:0;jenkins-hbase4:33981] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 06:02:55,165 INFO [RS:0;jenkins-hbase4:33981] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 06:02:55,165 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 06:02:55,165 INFO [RS:1;jenkins-hbase4:43903] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 06:02:55,166 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 06:02:55,166 INFO [RS:1;jenkins-hbase4:43903] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 06:02:55,166 INFO [RS:1;jenkins-hbase4:43903] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 06:02:55,166 INFO [RS:1;jenkins-hbase4:43903] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:55,166 DEBUG [RS:1;jenkins-hbase4:43903] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x665a0c5b to 127.0.0.1:56793 2023-02-12 06:02:55,166 DEBUG [RS:1;jenkins-hbase4:43903] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:02:55,166 INFO [RS:1;jenkins-hbase4:43903] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 06:02:55,166 INFO [RS:1;jenkins-hbase4:43903] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 06:02:55,166 INFO [RS:1;jenkins-hbase4:43903] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 06:02:55,167 INFO [RS:1;jenkins-hbase4:43903] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-12 06:02:55,167 INFO [RS:1;jenkins-hbase4:43903] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-12 06:02:55,166 INFO [RS:0;jenkins-hbase4:33981] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 06:02:55,167 DEBUG [RS:1;jenkins-hbase4:43903] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-12 06:02:55,167 INFO [RS:0;jenkins-hbase4:33981] regionserver.HRegionServer(3304): Received CLOSE for c291c28b895b1ef2c54c1251146821f9 2023-02-12 06:02:55,168 INFO [RS:0;jenkins-hbase4:33981] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:55,168 DEBUG [RS:0;jenkins-hbase4:33981] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x64a3a007 to 127.0.0.1:56793 2023-02-12 06:02:55,168 DEBUG [RS:0;jenkins-hbase4:33981] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:02:55,168 INFO [RS:0;jenkins-hbase4:33981] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-12 06:02:55,168 DEBUG [RS:0;jenkins-hbase4:33981] regionserver.HRegionServer(1479): Online Regions={c291c28b895b1ef2c54c1251146821f9=hbase:namespace,,1676181764032.c291c28b895b1ef2c54c1251146821f9.} 2023-02-12 06:02:55,170 DEBUG [RS:1;jenkins-hbase4:43903] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-12 06:02:55,170 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 06:02:55,170 DEBUG [RS:0;jenkins-hbase4:33981] regionserver.HRegionServer(1505): Waiting on c291c28b895b1ef2c54c1251146821f9 2023-02-12 06:02:55,170 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 06:02:55,170 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 06:02:55,170 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 06:02:55,170 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 06:02:55,171 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.29 KB heapSize=40.20 KB 2023-02-12 06:02:55,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c291c28b895b1ef2c54c1251146821f9, disabling compactions & flushes 2023-02-12 06:02:55,175 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676181764032.c291c28b895b1ef2c54c1251146821f9. 2023-02-12 06:02:55,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676181764032.c291c28b895b1ef2c54c1251146821f9. 2023-02-12 06:02:55,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676181764032.c291c28b895b1ef2c54c1251146821f9. after waiting 0 ms 2023-02-12 06:02:55,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676181764032.c291c28b895b1ef2c54c1251146821f9. 2023-02-12 06:02:55,175 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing c291c28b895b1ef2c54c1251146821f9 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-12 06:02:55,220 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/hbase/namespace/c291c28b895b1ef2c54c1251146821f9/.tmp/info/f86fa3888a814f1393286f6fa59c3411 2023-02-12 06:02:55,221 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 06:02:55,221 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 06:02:55,225 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.08 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/hbase/meta/1588230740/.tmp/info/9cb6c76607ca4c46b0db1317cf35eb4b 2023-02-12 06:02:55,234 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/hbase/namespace/c291c28b895b1ef2c54c1251146821f9/.tmp/info/f86fa3888a814f1393286f6fa59c3411 as hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/hbase/namespace/c291c28b895b1ef2c54c1251146821f9/info/f86fa3888a814f1393286f6fa59c3411 2023-02-12 06:02:55,240 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9cb6c76607ca4c46b0db1317cf35eb4b 2023-02-12 06:02:55,244 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/hbase/namespace/c291c28b895b1ef2c54c1251146821f9/info/f86fa3888a814f1393286f6fa59c3411, entries=2, sequenceid=6, filesize=4.8 K 2023-02-12 06:02:55,246 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for c291c28b895b1ef2c54c1251146821f9 in 71ms, sequenceid=6, compaction requested=false 2023-02-12 06:02:55,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/hbase/namespace/c291c28b895b1ef2c54c1251146821f9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-12 06:02:55,256 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676181764032.c291c28b895b1ef2c54c1251146821f9. 2023-02-12 06:02:55,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c291c28b895b1ef2c54c1251146821f9: Waiting for close lock at 1676181775170Running coprocessor pre-close hooks at 1676181775170Disabling compacts and flushes for region at 1676181775170Disabling writes for close at 1676181775175 (+5 ms)Obtaining lock to block concurrent updates at 1676181775175Preparing flush snapshotting stores in c291c28b895b1ef2c54c1251146821f9 at 1676181775175Finished memstore snapshotting hbase:namespace,,1676181764032.c291c28b895b1ef2c54c1251146821f9., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676181775176 (+1 ms)Flushing stores of hbase:namespace,,1676181764032.c291c28b895b1ef2c54c1251146821f9. at 1676181775176Flushing c291c28b895b1ef2c54c1251146821f9/info: creating writer at 1676181775176Flushing c291c28b895b1ef2c54c1251146821f9/info: appending metadata at 1676181775179 (+3 ms)Flushing c291c28b895b1ef2c54c1251146821f9/info: closing flushed file at 1676181775179Flushing c291c28b895b1ef2c54c1251146821f9/info: reopening flushed file at 1676181775235 (+56 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for c291c28b895b1ef2c54c1251146821f9 in 71ms, sequenceid=6, compaction requested=false at 1676181775246 (+11 ms)Writing region close event to WAL at 1676181775249 (+3 ms)Running coprocessor post-close hooks at 1676181775255 (+6 ms)Closed at 1676181775256 (+1 ms) 2023-02-12 06:02:55,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676181764032.c291c28b895b1ef2c54c1251146821f9. 2023-02-12 06:02:55,263 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/hbase/meta/1588230740/.tmp/rep_barrier/40206c14f06f45f4b3df2acc8ab6596f 2023-02-12 06:02:55,269 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 40206c14f06f45f4b3df2acc8ab6596f 2023-02-12 06:02:55,287 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/hbase/meta/1588230740/.tmp/table/cdb549eed6064aeca3485b038190d23c 2023-02-12 06:02:55,293 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cdb549eed6064aeca3485b038190d23c 2023-02-12 06:02:55,294 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/hbase/meta/1588230740/.tmp/info/9cb6c76607ca4c46b0db1317cf35eb4b as hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/hbase/meta/1588230740/info/9cb6c76607ca4c46b0db1317cf35eb4b 2023-02-12 06:02:55,296 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-12 06:02:55,296 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-12 06:02:55,298 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-12 06:02:55,298 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-12 06:02:55,300 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9cb6c76607ca4c46b0db1317cf35eb4b 2023-02-12 06:02:55,300 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/hbase/meta/1588230740/info/9cb6c76607ca4c46b0db1317cf35eb4b, entries=30, sequenceid=57, filesize=7.9 K 2023-02-12 06:02:55,301 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/hbase/meta/1588230740/.tmp/rep_barrier/40206c14f06f45f4b3df2acc8ab6596f as hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/hbase/meta/1588230740/rep_barrier/40206c14f06f45f4b3df2acc8ab6596f 2023-02-12 06:02:55,307 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 40206c14f06f45f4b3df2acc8ab6596f 2023-02-12 06:02:55,307 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/hbase/meta/1588230740/rep_barrier/40206c14f06f45f4b3df2acc8ab6596f, entries=10, sequenceid=57, filesize=5.9 K 2023-02-12 06:02:55,308 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/hbase/meta/1588230740/.tmp/table/cdb549eed6064aeca3485b038190d23c as hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/hbase/meta/1588230740/table/cdb549eed6064aeca3485b038190d23c 2023-02-12 06:02:55,315 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cdb549eed6064aeca3485b038190d23c 2023-02-12 06:02:55,315 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/hbase/meta/1588230740/table/cdb549eed6064aeca3485b038190d23c, entries=13, sequenceid=57, filesize=5.9 K 2023-02-12 06:02:55,316 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 146ms, sequenceid=57, compaction requested=false 2023-02-12 06:02:55,325 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-12 06:02:55,326 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 06:02:55,327 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 06:02:55,327 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676181775168Running coprocessor pre-close hooks at 1676181775168Disabling compacts and flushes for region at 1676181775168Disabling writes for close at 1676181775170 (+2 ms)Obtaining lock to block concurrent updates at 1676181775171 (+1 ms)Preparing flush snapshotting stores in 1588230740 at 1676181775171Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=24876, getHeapSize=41120, getOffHeapSize=0, getCellsCount=207 at 1676181775172 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1676181775173 (+1 ms)Flushing 1588230740/info: creating writer at 1676181775173Flushing 1588230740/info: appending metadata at 1676181775180 (+7 ms)Flushing 1588230740/info: closing flushed file at 1676181775180Flushing 1588230740/rep_barrier: creating writer at 1676181775241 (+61 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676181775246 (+5 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676181775246Flushing 1588230740/table: creating writer at 1676181775269 (+23 ms)Flushing 1588230740/table: appending metadata at 1676181775274 (+5 ms)Flushing 1588230740/table: closing flushed file at 1676181775274Flushing 1588230740/info: reopening flushed file at 1676181775295 (+21 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676181775302 (+7 ms)Flushing 1588230740/table: reopening flushed file at 1676181775309 (+7 ms)Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 146ms, sequenceid=57, compaction requested=false at 1676181775317 (+8 ms)Writing region close event to WAL at 1676181775321 (+4 ms)Running coprocessor post-close hooks at 1676181775326 (+5 ms)Closed at 1676181775327 (+1 ms) 2023-02-12 06:02:55,327 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-12 06:02:55,370 INFO [RS:1;jenkins-hbase4:43903] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43903,1676181760972; all regions closed. 2023-02-12 06:02:55,370 INFO [RS:0;jenkins-hbase4:33981] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,33981,1676181760918; all regions closed. 2023-02-12 06:02:55,381 DEBUG [RS:1;jenkins-hbase4:43903] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/oldWALs 2023-02-12 06:02:55,381 DEBUG [RS:0;jenkins-hbase4:33981] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/oldWALs 2023-02-12 06:02:55,381 INFO [RS:0;jenkins-hbase4:33981] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33981%2C1676181760918:(num 1676181764354) 2023-02-12 06:02:55,381 INFO [RS:1;jenkins-hbase4:43903] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43903%2C1676181760972.meta:.meta(num 1676181763734) 2023-02-12 06:02:55,381 DEBUG [RS:0;jenkins-hbase4:33981] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:02:55,381 INFO [RS:0;jenkins-hbase4:33981] regionserver.LeaseManager(133): Closed leases 2023-02-12 06:02:55,381 INFO [RS:0;jenkins-hbase4:33981] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-12 06:02:55,382 INFO [RS:0;jenkins-hbase4:33981] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 06:02:55,382 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 06:02:55,382 INFO [RS:0;jenkins-hbase4:33981] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 06:02:55,382 INFO [RS:0;jenkins-hbase4:33981] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 06:02:55,385 INFO [RS:0;jenkins-hbase4:33981] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33981 2023-02-12 06:02:55,393 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): regionserver:33981-0x100471fcd120001, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:55,393 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): regionserver:43903-0x100471fcd120002, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33981,1676181760918 2023-02-12 06:02:55,393 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): regionserver:43903-0x100471fcd120002, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 06:02:55,393 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 06:02:55,393 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): regionserver:33981-0x100471fcd120001, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 06:02:55,395 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33981,1676181760918] 2023-02-12 06:02:55,395 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33981,1676181760918; numProcessing=1 2023-02-12 06:02:55,396 DEBUG [RS:1;jenkins-hbase4:43903] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/oldWALs 2023-02-12 06:02:55,396 INFO [RS:1;jenkins-hbase4:43903] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43903%2C1676181760972:(num 1676181764355) 2023-02-12 06:02:55,396 DEBUG [RS:1;jenkins-hbase4:43903] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:02:55,396 INFO [RS:1;jenkins-hbase4:43903] regionserver.LeaseManager(133): Closed leases 2023-02-12 06:02:55,396 INFO [RS:1;jenkins-hbase4:43903] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-12 06:02:55,398 INFO [RS:1;jenkins-hbase4:43903] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43903 2023-02-12 06:02:55,398 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 06:02:55,495 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): regionserver:33981-0x100471fcd120001, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:02:55,495 INFO [RS:0;jenkins-hbase4:33981] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,33981,1676181760918; zookeeper connection closed. 2023-02-12 06:02:55,496 ERROR [Listener at localhost/44119-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7ad761bc rejected from java.util.concurrent.ThreadPoolExecutor@7ee8ea3e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:02:55,496 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6e742c7f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6e742c7f 2023-02-12 06:02:55,496 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): regionserver:33981-0x100471fcd120001, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:02:55,496 ERROR [Listener at localhost/44119-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4b808745 rejected from java.util.concurrent.ThreadPoolExecutor@7ee8ea3e[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:02:55,498 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): regionserver:43903-0x100471fcd120002, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43903,1676181760972 2023-02-12 06:02:55,498 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 06:02:55,498 ERROR [Listener at localhost/44119-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2e4905f3 rejected from java.util.concurrent.ThreadPoolExecutor@2a7684e2[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1374) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:02:55,498 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33981,1676181760918 already deleted, retry=false 2023-02-12 06:02:55,498 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33981,1676181760918 expired; onlineServers=1 2023-02-12 06:02:55,500 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43903,1676181760972] 2023-02-12 06:02:55,500 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43903,1676181760972; numProcessing=2 2023-02-12 06:02:55,501 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43903,1676181760972 already deleted, retry=false 2023-02-12 06:02:55,501 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43903,1676181760972 expired; onlineServers=0 2023-02-12 06:02:55,501 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40371,1676181759683' ***** 2023-02-12 06:02:55,501 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-12 06:02:55,502 DEBUG [M:0;jenkins-hbase4:40371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@452a4e95, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 06:02:55,502 INFO [M:0;jenkins-hbase4:40371] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40371,1676181759683 2023-02-12 06:02:55,502 INFO [M:0;jenkins-hbase4:40371] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40371,1676181759683; all regions closed. 2023-02-12 06:02:55,502 DEBUG [M:0;jenkins-hbase4:40371] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:02:55,502 DEBUG [M:0;jenkins-hbase4:40371] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-12 06:02:55,502 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-12 06:02:55,503 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676181762188] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676181762188,5,FailOnTimeoutGroup] 2023-02-12 06:02:55,503 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676181762188] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676181762188,5,FailOnTimeoutGroup] 2023-02-12 06:02:55,502 DEBUG [M:0;jenkins-hbase4:40371] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-12 06:02:55,504 INFO [M:0;jenkins-hbase4:40371] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-12 06:02:55,505 INFO [M:0;jenkins-hbase4:40371] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-12 06:02:55,505 INFO [M:0;jenkins-hbase4:40371] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-12 06:02:55,505 DEBUG [M:0;jenkins-hbase4:40371] master.HMaster(1502): Stopping service threads 2023-02-12 06:02:55,506 INFO [M:0;jenkins-hbase4:40371] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-12 06:02:55,506 ERROR [M:0;jenkins-hbase4:40371] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-12 06:02:55,506 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] 2023-02-12 06:02:55,506 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-12 06:02:55,507 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 06:02:55,507 INFO [M:0;jenkins-hbase4:40371] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-12 06:02:55,507 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-12 06:02:55,508 DEBUG [M:0;jenkins-hbase4:40371] zookeeper.ZKUtil(398): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-12 06:02:55,508 WARN [M:0;jenkins-hbase4:40371] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-12 06:02:55,508 INFO [M:0;jenkins-hbase4:40371] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-12 06:02:55,508 INFO [M:0;jenkins-hbase4:40371] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-12 06:02:55,509 DEBUG [M:0;jenkins-hbase4:40371] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 06:02:55,509 INFO [M:0;jenkins-hbase4:40371] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:02:55,509 DEBUG [M:0;jenkins-hbase4:40371] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:02:55,509 DEBUG [M:0;jenkins-hbase4:40371] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 06:02:55,509 DEBUG [M:0;jenkins-hbase4:40371] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:02:55,509 INFO [M:0;jenkins-hbase4:40371] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=159.24 KB heapSize=192.16 KB 2023-02-12 06:02:55,527 INFO [M:0;jenkins-hbase4:40371] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=159.24 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6cd4c2e15e2f490292cc7303298db025 2023-02-12 06:02:55,533 DEBUG [M:0;jenkins-hbase4:40371] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6cd4c2e15e2f490292cc7303298db025 as hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6cd4c2e15e2f490292cc7303298db025 2023-02-12 06:02:55,539 INFO [M:0;jenkins-hbase4:40371] regionserver.HStore(1080): Added hdfs://localhost:38185/user/jenkins/test-data/e9e70569-1df6-0e96-844c-eabe3838eaec/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6cd4c2e15e2f490292cc7303298db025, entries=53, sequenceid=357, filesize=10.4 K 2023-02-12 06:02:55,540 INFO [M:0;jenkins-hbase4:40371] regionserver.HRegion(2947): Finished flush of dataSize ~159.24 KB/163064, heapSize ~192.14 KB/196752, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 31ms, sequenceid=357, compaction requested=false 2023-02-12 06:02:55,542 INFO [M:0;jenkins-hbase4:40371] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:02:55,542 DEBUG [M:0;jenkins-hbase4:40371] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676181775508Disabling compacts and flushes for region at 1676181775508Disabling writes for close at 1676181775509 (+1 ms)Obtaining lock to block concurrent updates at 1676181775509Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676181775509Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=163064, getHeapSize=196752, getOffHeapSize=0, getCellsCount=442 at 1676181775509Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676181775510 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676181775511 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676181775515 (+4 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676181775515Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676181775534 (+19 ms)Finished flush of dataSize ~159.24 KB/163064, heapSize ~192.14 KB/196752, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 31ms, sequenceid=357, compaction requested=false at 1676181775540 (+6 ms)Writing region close event to WAL at 1676181775542 (+2 ms)Closed at 1676181775542 2023-02-12 06:02:55,548 INFO [M:0;jenkins-hbase4:40371] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-12 06:02:55,548 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 06:02:55,549 INFO [M:0;jenkins-hbase4:40371] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40371 2023-02-12 06:02:55,554 DEBUG [M:0;jenkins-hbase4:40371] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40371,1676181759683 already deleted, retry=false 2023-02-12 06:02:55,600 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): regionserver:43903-0x100471fcd120002, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:02:55,600 ERROR [Listener at localhost/44119-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@38518fcb rejected from java.util.concurrent.ThreadPoolExecutor@2a7684e2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:02:55,601 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): regionserver:43903-0x100471fcd120002, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:02:55,601 ERROR [Listener at localhost/44119-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@409ebd13 rejected from java.util.concurrent.ThreadPoolExecutor@2a7684e2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:02:55,603 INFO [RS:1;jenkins-hbase4:43903] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43903,1676181760972; zookeeper connection closed. 2023-02-12 06:02:55,604 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@70de0e9c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@70de0e9c 2023-02-12 06:02:55,604 INFO [Listener at localhost/44119] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-12 06:02:55,701 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:02:55,701 ERROR [Listener at localhost/44119-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@748d6dca rejected from java.util.concurrent.ThreadPoolExecutor@76106f20[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:02:55,701 INFO [M:0;jenkins-hbase4:40371] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40371,1676181759683; zookeeper connection closed. 2023-02-12 06:02:55,701 DEBUG [Listener at localhost/44119-EventThread] zookeeper.ZKWatcher(600): master:40371-0x100471fcd120000, quorum=127.0.0.1:56793, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:02:55,701 ERROR [Listener at localhost/44119-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7742cdb rejected from java.util.concurrent.ThreadPoolExecutor@76106f20[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:02:55,703 WARN [Listener at localhost/44119] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 06:02:55,722 INFO [Listener at localhost/44119] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 06:02:55,828 WARN [BP-386015050-172.31.14.131-1676181755961 heartbeating to localhost/127.0.0.1:38185] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 06:02:55,828 WARN [BP-386015050-172.31.14.131-1676181755961 heartbeating to localhost/127.0.0.1:38185] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-386015050-172.31.14.131-1676181755961 (Datanode Uuid 4c83e6ca-3088-4d38-a8b6-50b097ccbfb2) service to localhost/127.0.0.1:38185 2023-02-12 06:02:55,830 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7/cluster_c92385aa-bc56-4d3f-e0f4-47a0181104fa/dfs/data/data3/current/BP-386015050-172.31.14.131-1676181755961] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 06:02:55,831 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7/cluster_c92385aa-bc56-4d3f-e0f4-47a0181104fa/dfs/data/data4/current/BP-386015050-172.31.14.131-1676181755961] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 06:02:55,833 WARN [Listener at localhost/44119] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 06:02:55,837 INFO [Listener at localhost/44119] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 06:02:55,941 WARN [BP-386015050-172.31.14.131-1676181755961 heartbeating to localhost/127.0.0.1:38185] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 06:02:55,941 WARN [BP-386015050-172.31.14.131-1676181755961 heartbeating to localhost/127.0.0.1:38185] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-386015050-172.31.14.131-1676181755961 (Datanode Uuid 03d78fa7-53d1-4950-a704-f3f7d74a0ad4) service to localhost/127.0.0.1:38185 2023-02-12 06:02:55,942 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7/cluster_c92385aa-bc56-4d3f-e0f4-47a0181104fa/dfs/data/data1/current/BP-386015050-172.31.14.131-1676181755961] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 06:02:55,942 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7/cluster_c92385aa-bc56-4d3f-e0f4-47a0181104fa/dfs/data/data2/current/BP-386015050-172.31.14.131-1676181755961] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 06:02:55,976 INFO [Listener at localhost/44119] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 06:02:56,102 INFO [Listener at localhost/44119] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-12 06:02:56,206 INFO [Listener at localhost/44119] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-12 06:02:56,224 INFO [Listener at localhost/44119] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=104 (was 7) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:38185 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:38185 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:300) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@627339b4 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:38185 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/44119 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost:38185 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,40371,1676181759683)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:38185 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:38185 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:38185 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=543 (was 240) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=337 (was 154) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=4559 (was 5610) 2023-02-12 06:02:56,235 INFO [Listener at localhost/44119] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=104, OpenFileDescriptor=543, MaxFileDescriptor=60000, SystemLoadAverage=337, ProcessCount=166, AvailableMemoryMB=4558 2023-02-12 06:02:56,250 INFO [Listener at localhost/44119] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7/hadoop.log.dir so I do NOT create it in target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84 2023-02-12 06:02:56,250 WARN [Listener at localhost/44119] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7/hadoop.log.dir Erasing configuration value by system value. 2023-02-12 06:02:56,250 INFO [Listener at localhost/44119] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7/hadoop.tmp.dir so I do NOT create it in target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84 2023-02-12 06:02:56,250 WARN [Listener at localhost/44119] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8674d73b-f4e1-9de8-ce88-54cfb839f6d7/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-12 06:02:56,250 DEBUG [Listener at localhost/44119] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84 2023-02-12 06:02:56,250 INFO [Listener at localhost/44119] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-12 06:02:56,250 INFO [Listener at localhost/44119] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84/cluster_ee3ede3e-352c-b98c-5116-0a645cdf8bab, deleteOnExit=true 2023-02-12 06:02:56,250 INFO [Listener at localhost/44119] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-12 06:02:56,251 INFO [Listener at localhost/44119] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84/test.cache.data in system properties and HBase conf 2023-02-12 06:02:56,251 INFO [Listener at localhost/44119] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84/hadoop.tmp.dir in system properties and HBase conf 2023-02-12 06:02:56,251 INFO [Listener at localhost/44119] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84/hadoop.log.dir in system properties and HBase conf 2023-02-12 06:02:56,251 INFO [Listener at localhost/44119] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-12 06:02:56,251 INFO [Listener at localhost/44119] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-12 06:02:56,252 INFO [Listener at localhost/44119] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-12 06:02:56,252 DEBUG [Listener at localhost/44119] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-12 06:02:56,252 INFO [Listener at localhost/44119] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-12 06:02:56,252 INFO [Listener at localhost/44119] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-12 06:02:56,252 INFO [Listener at localhost/44119] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-12 06:02:56,253 INFO [Listener at localhost/44119] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 06:02:56,253 INFO [Listener at localhost/44119] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-12 06:02:56,253 INFO [Listener at localhost/44119] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-12 06:02:56,253 INFO [Listener at localhost/44119] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 06:02:56,253 INFO [Listener at localhost/44119] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 06:02:56,254 INFO [Listener at localhost/44119] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-12 06:02:56,254 INFO [Listener at localhost/44119] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84/nfs.dump.dir in system properties and HBase conf 2023-02-12 06:02:56,254 INFO [Listener at localhost/44119] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84/java.io.tmpdir in system properties and HBase conf 2023-02-12 06:02:56,254 INFO [Listener at localhost/44119] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 06:02:56,254 INFO [Listener at localhost/44119] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-12 06:02:56,254 INFO [Listener at localhost/44119] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-12 06:02:56,260 WARN [Listener at localhost/44119] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 06:02:56,260 WARN [Listener at localhost/44119] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 06:02:56,322 WARN [Listener at localhost/44119] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 06:02:56,325 INFO [Listener at localhost/44119] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 06:02:56,333 INFO [Listener at localhost/44119] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84/java.io.tmpdir/Jetty_localhost_37965_hdfs____.gx3uki/webapp 2023-02-12 06:02:56,445 INFO [Listener at localhost/44119] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37965 2023-02-12 06:02:56,450 WARN [Listener at localhost/44119] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 06:02:56,450 WARN [Listener at localhost/44119] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 06:02:56,494 WARN [Listener at localhost/34365] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 06:02:56,511 WARN [Listener at localhost/34365] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 06:02:56,514 WARN [Listener at localhost/34365] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 06:02:56,516 INFO [Listener at localhost/34365] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 06:02:56,523 INFO [Listener at localhost/34365] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84/java.io.tmpdir/Jetty_localhost_42323_datanode____.v9dmeb/webapp 2023-02-12 06:02:56,622 INFO [Listener at localhost/34365] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42323 2023-02-12 06:02:56,630 WARN [Listener at localhost/41939] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 06:02:56,651 WARN [Listener at localhost/41939] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 06:02:56,653 WARN [Listener at localhost/41939] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 06:02:56,654 INFO [Listener at localhost/41939] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 06:02:56,658 INFO [Listener at localhost/41939] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84/java.io.tmpdir/Jetty_localhost_33015_datanode____3u489n/webapp 2023-02-12 06:02:56,753 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xeb10344a3e3ff92a: Processing first storage report for DS-2fefe694-2ab8-4f6f-ac05-00b420e7b349 from datanode 78a26fd7-c9e0-4f8a-8b17-c5f3dc565f54 2023-02-12 06:02:56,754 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xeb10344a3e3ff92a: from storage DS-2fefe694-2ab8-4f6f-ac05-00b420e7b349 node DatanodeRegistration(127.0.0.1:34227, datanodeUuid=78a26fd7-c9e0-4f8a-8b17-c5f3dc565f54, infoPort=42463, infoSecurePort=0, ipcPort=41939, storageInfo=lv=-57;cid=testClusterID;nsid=1531655956;c=1676181776263), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 06:02:56,754 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xeb10344a3e3ff92a: Processing first storage report for DS-87aa8a74-120a-44de-9150-64b44c0af6c5 from datanode 78a26fd7-c9e0-4f8a-8b17-c5f3dc565f54 2023-02-12 06:02:56,754 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xeb10344a3e3ff92a: from storage DS-87aa8a74-120a-44de-9150-64b44c0af6c5 node DatanodeRegistration(127.0.0.1:34227, datanodeUuid=78a26fd7-c9e0-4f8a-8b17-c5f3dc565f54, infoPort=42463, infoSecurePort=0, ipcPort=41939, storageInfo=lv=-57;cid=testClusterID;nsid=1531655956;c=1676181776263), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 06:02:56,776 INFO [Listener at localhost/41939] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33015 2023-02-12 06:02:56,801 WARN [Listener at localhost/40063] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 06:02:56,929 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x53a4c0ffe88edf76: Processing first storage report for DS-cdcb23ac-f2b8-4f06-8bd5-2346dbe72385 from datanode 30b17fb1-c4a5-4113-a0aa-16f5e97f599d 2023-02-12 06:02:56,930 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x53a4c0ffe88edf76: from storage DS-cdcb23ac-f2b8-4f06-8bd5-2346dbe72385 node DatanodeRegistration(127.0.0.1:40431, datanodeUuid=30b17fb1-c4a5-4113-a0aa-16f5e97f599d, infoPort=44157, infoSecurePort=0, ipcPort=40063, storageInfo=lv=-57;cid=testClusterID;nsid=1531655956;c=1676181776263), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-12 06:02:56,930 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x53a4c0ffe88edf76: Processing first storage report for DS-bbe0e658-9028-4734-b463-5cfe47e5961a from datanode 30b17fb1-c4a5-4113-a0aa-16f5e97f599d 2023-02-12 06:02:56,930 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x53a4c0ffe88edf76: from storage DS-bbe0e658-9028-4734-b463-5cfe47e5961a node DatanodeRegistration(127.0.0.1:40431, datanodeUuid=30b17fb1-c4a5-4113-a0aa-16f5e97f599d, infoPort=44157, infoSecurePort=0, ipcPort=40063, storageInfo=lv=-57;cid=testClusterID;nsid=1531655956;c=1676181776263), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 06:02:57,029 DEBUG [Listener at localhost/40063] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84 2023-02-12 06:02:57,035 INFO [Listener at localhost/40063] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84/cluster_ee3ede3e-352c-b98c-5116-0a645cdf8bab/zookeeper_0, clientPort=61935, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84/cluster_ee3ede3e-352c-b98c-5116-0a645cdf8bab/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84/cluster_ee3ede3e-352c-b98c-5116-0a645cdf8bab/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-12 06:02:57,037 INFO [Listener at localhost/40063] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=61935 2023-02-12 06:02:57,037 INFO [Listener at localhost/40063] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:02:57,039 INFO [Listener at localhost/40063] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:02:57,066 INFO [Listener at localhost/40063] util.FSUtils(479): Created version file at hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc with version=8 2023-02-12 06:02:57,066 INFO [Listener at localhost/40063] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:02:57,068 INFO [Listener at localhost/40063] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:02:57,069 INFO [Listener at localhost/40063] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/hbase-staging 2023-02-12 06:02:57,072 INFO [Listener at localhost/40063] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 06:02:57,072 INFO [Listener at localhost/40063] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:02:57,072 INFO [Listener at localhost/40063] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 06:02:57,072 INFO [Listener at localhost/40063] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 06:02:57,072 INFO [Listener at localhost/40063] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:02:57,072 INFO [Listener at localhost/40063] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 06:02:57,073 INFO [Listener at localhost/40063] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 06:02:57,075 INFO [Listener at localhost/40063] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45631 2023-02-12 06:02:57,076 INFO [Listener at localhost/40063] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:02:57,077 INFO [Listener at localhost/40063] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:02:57,078 INFO [Listener at localhost/40063] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45631 connecting to ZooKeeper ensemble=127.0.0.1:61935 2023-02-12 06:02:57,094 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:456310x0, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 06:02:57,097 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:45631-0x1004720144c0000 connected 2023-02-12 06:02:57,131 DEBUG [Listener at localhost/40063] zookeeper.ZKUtil(164): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 06:02:57,135 DEBUG [Listener at localhost/40063] zookeeper.ZKUtil(164): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:02:57,135 DEBUG [Listener at localhost/40063] zookeeper.ZKUtil(164): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 06:02:57,140 DEBUG [Listener at localhost/40063] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45631 2023-02-12 06:02:57,141 DEBUG [Listener at localhost/40063] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45631 2023-02-12 06:02:57,142 DEBUG [Listener at localhost/40063] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45631 2023-02-12 06:02:57,148 DEBUG [Listener at localhost/40063] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45631 2023-02-12 06:02:57,148 DEBUG [Listener at localhost/40063] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45631 2023-02-12 06:02:57,148 INFO [Listener at localhost/40063] master.HMaster(439): hbase.rootdir=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc, hbase.cluster.distributed=false 2023-02-12 06:02:57,168 INFO [Listener at localhost/40063] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 06:02:57,168 INFO [Listener at localhost/40063] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:02:57,168 INFO [Listener at localhost/40063] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 06:02:57,168 INFO [Listener at localhost/40063] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 06:02:57,169 INFO [Listener at localhost/40063] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:02:57,169 INFO [Listener at localhost/40063] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 06:02:57,169 INFO [Listener at localhost/40063] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 06:02:57,174 INFO [Listener at localhost/40063] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42183 2023-02-12 06:02:57,175 INFO [Listener at localhost/40063] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 06:02:57,176 DEBUG [Listener at localhost/40063] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:02:57,176 INFO [Listener at localhost/40063] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:02:57,177 INFO [Listener at localhost/40063] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:02:57,178 INFO [Listener at localhost/40063] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42183 connecting to ZooKeeper ensemble=127.0.0.1:61935 2023-02-12 06:02:57,181 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): regionserver:421830x0, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 06:02:57,182 DEBUG [Listener at localhost/40063] zookeeper.ZKUtil(164): regionserver:421830x0, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 06:02:57,183 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:42183-0x1004720144c0001 connected 2023-02-12 06:02:57,183 DEBUG [Listener at localhost/40063] zookeeper.ZKUtil(164): regionserver:42183-0x1004720144c0001, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:02:57,184 DEBUG [Listener at localhost/40063] zookeeper.ZKUtil(164): regionserver:42183-0x1004720144c0001, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 06:02:57,188 DEBUG [Listener at localhost/40063] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42183 2023-02-12 06:02:57,188 DEBUG [Listener at localhost/40063] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42183 2023-02-12 06:02:57,189 DEBUG [Listener at localhost/40063] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42183 2023-02-12 06:02:57,190 DEBUG [Listener at localhost/40063] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42183 2023-02-12 06:02:57,192 DEBUG [Listener at localhost/40063] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42183 2023-02-12 06:02:57,204 INFO [Listener at localhost/40063] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 06:02:57,204 INFO [Listener at localhost/40063] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:02:57,204 INFO [Listener at localhost/40063] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 06:02:57,204 INFO [Listener at localhost/40063] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 06:02:57,205 INFO [Listener at localhost/40063] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:02:57,205 INFO [Listener at localhost/40063] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 06:02:57,205 INFO [Listener at localhost/40063] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 06:02:57,206 INFO [Listener at localhost/40063] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37181 2023-02-12 06:02:57,207 INFO [Listener at localhost/40063] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 06:02:57,208 DEBUG [Listener at localhost/40063] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:02:57,209 INFO [Listener at localhost/40063] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:02:57,210 INFO [Listener at localhost/40063] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:02:57,211 INFO [Listener at localhost/40063] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37181 connecting to ZooKeeper ensemble=127.0.0.1:61935 2023-02-12 06:02:57,216 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): regionserver:371810x0, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 06:02:57,217 DEBUG [Listener at localhost/40063] zookeeper.ZKUtil(164): regionserver:371810x0, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 06:02:57,217 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:37181-0x1004720144c0002 connected 2023-02-12 06:02:57,218 DEBUG [Listener at localhost/40063] zookeeper.ZKUtil(164): regionserver:37181-0x1004720144c0002, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:02:57,218 DEBUG [Listener at localhost/40063] zookeeper.ZKUtil(164): regionserver:37181-0x1004720144c0002, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 06:02:57,220 DEBUG [Listener at localhost/40063] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37181 2023-02-12 06:02:57,220 DEBUG [Listener at localhost/40063] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37181 2023-02-12 06:02:57,224 DEBUG [Listener at localhost/40063] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37181 2023-02-12 06:02:57,224 DEBUG [Listener at localhost/40063] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37181 2023-02-12 06:02:57,227 DEBUG [Listener at localhost/40063] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37181 2023-02-12 06:02:57,230 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,45631,1676181777071 2023-02-12 06:02:57,237 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 06:02:57,238 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,45631,1676181777071 2023-02-12 06:02:57,239 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 06:02:57,239 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): regionserver:37181-0x1004720144c0002, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 06:02:57,239 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:02:57,239 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): regionserver:42183-0x1004720144c0001, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 06:02:57,240 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 06:02:57,242 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,45631,1676181777071 from backup master directory 2023-02-12 06:02:57,242 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 06:02:57,244 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,45631,1676181777071 2023-02-12 06:02:57,244 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 06:02:57,244 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 06:02:57,244 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,45631,1676181777071 2023-02-12 06:02:57,263 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/hbase.id with ID: 0f699fb7-43a0-4923-a027-9696be7ed5c8 2023-02-12 06:02:57,274 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:02:57,277 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:02:57,289 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x153698ee to 127.0.0.1:61935 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 06:02:57,296 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70abc55f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 06:02:57,296 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 06:02:57,297 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-12 06:02:57,297 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 06:02:57,299 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/MasterData/data/master/store-tmp 2023-02-12 06:02:57,310 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:57,310 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 06:02:57,310 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:02:57,310 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:02:57,310 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 06:02:57,310 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:02:57,310 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:02:57,310 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676181777310Disabling compacts and flushes for region at 1676181777310Disabling writes for close at 1676181777310Writing region close event to WAL at 1676181777310Closed at 1676181777310 2023-02-12 06:02:57,311 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/MasterData/WALs/jenkins-hbase4.apache.org,45631,1676181777071 2023-02-12 06:02:57,313 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45631%2C1676181777071, suffix=, logDir=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/MasterData/WALs/jenkins-hbase4.apache.org,45631,1676181777071, archiveDir=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/MasterData/oldWALs, maxLogs=10 2023-02-12 06:02:57,330 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40431,DS-cdcb23ac-f2b8-4f06-8bd5-2346dbe72385,DISK] 2023-02-12 06:02:57,331 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34227,DS-2fefe694-2ab8-4f6f-ac05-00b420e7b349,DISK] 2023-02-12 06:02:57,334 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/MasterData/WALs/jenkins-hbase4.apache.org,45631,1676181777071/jenkins-hbase4.apache.org%2C45631%2C1676181777071.1676181777313 2023-02-12 06:02:57,336 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40431,DS-cdcb23ac-f2b8-4f06-8bd5-2346dbe72385,DISK], DatanodeInfoWithStorage[127.0.0.1:34227,DS-2fefe694-2ab8-4f6f-ac05-00b420e7b349,DISK]] 2023-02-12 06:02:57,336 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-12 06:02:57,336 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:57,336 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:02:57,336 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:02:57,337 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:02:57,339 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-12 06:02:57,339 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-12 06:02:57,340 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:57,341 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:02:57,341 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:02:57,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:02:57,346 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:02:57,346 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68286962, jitterRate=0.017555028200149536}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 06:02:57,346 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676181777336Initializing all the Stores at 1676181777337 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181777337Cleaning up temporary data from old regions at 1676181777342 (+5 ms)Cleaning up detritus from prior splits at 1676181777342Region opened successfully at 1676181777346 (+4 ms) 2023-02-12 06:02:57,346 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-12 06:02:57,348 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-12 06:02:57,348 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-12 06:02:57,348 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-12 06:02:57,348 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-12 06:02:57,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-12 06:02:57,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-12 06:02:57,349 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-12 06:02:57,350 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-12 06:02:57,368 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-12 06:02:57,368 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-12 06:02:57,369 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-12 06:02:57,369 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-12 06:02:57,369 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-12 06:02:57,371 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:02:57,372 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-12 06:02:57,372 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-12 06:02:57,373 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-12 06:02:57,374 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): regionserver:37181-0x1004720144c0002, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 06:02:57,374 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 06:02:57,374 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): regionserver:42183-0x1004720144c0001, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 06:02:57,375 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:02:57,375 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,45631,1676181777071, sessionid=0x1004720144c0000, setting cluster-up flag (Was=false) 2023-02-12 06:02:57,380 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:02:57,384 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-12 06:02:57,385 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45631,1676181777071 2023-02-12 06:02:57,388 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:02:57,393 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-12 06:02:57,394 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45631,1676181777071 2023-02-12 06:02:57,394 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.hbase-snapshot/.tmp 2023-02-12 06:02:57,396 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-12 06:02:57,397 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 06:02:57,397 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 06:02:57,397 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 06:02:57,397 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 06:02:57,397 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-12 06:02:57,397 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:02:57,397 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 06:02:57,397 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:02:57,403 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676181807403 2023-02-12 06:02:57,403 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 06:02:57,403 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-12 06:02:57,403 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-12 06:02:57,403 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-12 06:02:57,403 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-12 06:02:57,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-12 06:02:57,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-12 06:02:57,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-12 06:02:57,405 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 06:02:57,412 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:57,413 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-12 06:02:57,413 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-12 06:02:57,413 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-12 06:02:57,414 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-12 06:02:57,414 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-12 06:02:57,414 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676181777414,5,FailOnTimeoutGroup] 2023-02-12 06:02:57,415 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676181777414,5,FailOnTimeoutGroup] 2023-02-12 06:02:57,415 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:57,415 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-12 06:02:57,415 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:57,415 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:57,424 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 06:02:57,425 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 06:02:57,425 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc 2023-02-12 06:02:57,431 INFO [RS:0;jenkins-hbase4:42183] regionserver.HRegionServer(952): ClusterId : 0f699fb7-43a0-4923-a027-9696be7ed5c8 2023-02-12 06:02:57,431 INFO [RS:1;jenkins-hbase4:37181] regionserver.HRegionServer(952): ClusterId : 0f699fb7-43a0-4923-a027-9696be7ed5c8 2023-02-12 06:02:57,431 DEBUG [RS:0;jenkins-hbase4:42183] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 06:02:57,431 DEBUG [RS:1;jenkins-hbase4:37181] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 06:02:57,433 DEBUG [RS:0;jenkins-hbase4:42183] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 06:02:57,433 DEBUG [RS:0;jenkins-hbase4:42183] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 06:02:57,433 DEBUG [RS:1;jenkins-hbase4:37181] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 06:02:57,433 DEBUG [RS:1;jenkins-hbase4:37181] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 06:02:57,436 DEBUG [RS:0;jenkins-hbase4:42183] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 06:02:57,440 DEBUG [RS:0;jenkins-hbase4:42183] zookeeper.ReadOnlyZKClient(139): Connect 0x33c811c2 to 127.0.0.1:61935 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 06:02:57,441 DEBUG [RS:1;jenkins-hbase4:37181] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 06:02:57,442 DEBUG [RS:1;jenkins-hbase4:37181] zookeeper.ReadOnlyZKClient(139): Connect 0x32190e9c to 127.0.0.1:61935 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 06:02:57,449 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:57,453 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 06:02:57,454 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/hbase/meta/1588230740/info 2023-02-12 06:02:57,455 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 06:02:57,455 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:57,456 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 06:02:57,456 DEBUG [RS:0;jenkins-hbase4:42183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d0ff9cb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 06:02:57,457 DEBUG [RS:1;jenkins-hbase4:37181] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3cdee6af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 06:02:57,457 DEBUG [RS:0;jenkins-hbase4:42183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39307ab2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 06:02:57,457 DEBUG [RS:1;jenkins-hbase4:37181] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@38e165ec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 06:02:57,457 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/hbase/meta/1588230740/rep_barrier 2023-02-12 06:02:57,458 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 06:02:57,459 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:57,459 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 06:02:57,460 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/hbase/meta/1588230740/table 2023-02-12 06:02:57,461 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 06:02:57,461 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:57,462 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/hbase/meta/1588230740 2023-02-12 06:02:57,462 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/hbase/meta/1588230740 2023-02-12 06:02:57,464 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 06:02:57,467 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 06:02:57,468 DEBUG [RS:1;jenkins-hbase4:37181] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:37181 2023-02-12 06:02:57,468 DEBUG [RS:0;jenkins-hbase4:42183] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:42183 2023-02-12 06:02:57,468 INFO [RS:1;jenkins-hbase4:37181] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 06:02:57,468 INFO [RS:1;jenkins-hbase4:37181] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 06:02:57,468 INFO [RS:0;jenkins-hbase4:42183] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 06:02:57,468 INFO [RS:0;jenkins-hbase4:42183] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 06:02:57,468 DEBUG [RS:1;jenkins-hbase4:37181] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 06:02:57,468 DEBUG [RS:0;jenkins-hbase4:42183] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 06:02:57,469 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:02:57,469 INFO [RS:1;jenkins-hbase4:37181] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45631,1676181777071 with isa=jenkins-hbase4.apache.org/172.31.14.131:37181, startcode=1676181777204 2023-02-12 06:02:57,469 INFO [RS:0;jenkins-hbase4:42183] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,45631,1676181777071 with isa=jenkins-hbase4.apache.org/172.31.14.131:42183, startcode=1676181777167 2023-02-12 06:02:57,469 DEBUG [RS:1;jenkins-hbase4:37181] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 06:02:57,470 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73627416, jitterRate=0.09713399410247803}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 06:02:57,469 DEBUG [RS:0;jenkins-hbase4:42183] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 06:02:57,470 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676181777449Initializing all the Stores at 1676181777450 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676181777450Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181777452 (+2 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676181777452Cleaning up temporary data from old regions at 1676181777463 (+11 ms)Cleaning up detritus from prior splits at 1676181777464 (+1 ms)Region opened successfully at 1676181777470 (+6 ms) 2023-02-12 06:02:57,472 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 06:02:57,473 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 06:02:57,473 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 06:02:57,473 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 06:02:57,473 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 06:02:57,474 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49275, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 06:02:57,475 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 06:02:57,475 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676181777472Disabling compacts and flushes for region at 1676181777472Disabling writes for close at 1676181777473 (+1 ms)Writing region close event to WAL at 1676181777475 (+2 ms)Closed at 1676181777475 2023-02-12 06:02:57,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45631] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:02:57,476 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57187, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 06:02:57,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45631] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:02:57,476 DEBUG [RS:0;jenkins-hbase4:42183] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc 2023-02-12 06:02:57,477 DEBUG [RS:0;jenkins-hbase4:42183] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:34365 2023-02-12 06:02:57,477 DEBUG [RS:0;jenkins-hbase4:42183] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 06:02:57,477 DEBUG [RS:1;jenkins-hbase4:37181] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc 2023-02-12 06:02:57,477 DEBUG [RS:1;jenkins-hbase4:37181] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:34365 2023-02-12 06:02:57,477 DEBUG [RS:1;jenkins-hbase4:37181] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 06:02:57,477 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 06:02:57,477 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-12 06:02:57,477 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-12 06:02:57,478 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 06:02:57,479 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-12 06:02:57,482 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-12 06:02:57,482 DEBUG [RS:0;jenkins-hbase4:42183] zookeeper.ZKUtil(162): regionserver:42183-0x1004720144c0001, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:02:57,483 WARN [RS:0;jenkins-hbase4:42183] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 06:02:57,483 DEBUG [RS:1;jenkins-hbase4:37181] zookeeper.ZKUtil(162): regionserver:37181-0x1004720144c0002, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:02:57,483 INFO [RS:0;jenkins-hbase4:42183] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 06:02:57,483 WARN [RS:1;jenkins-hbase4:37181] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 06:02:57,483 DEBUG [RS:0;jenkins-hbase4:42183] regionserver.HRegionServer(1947): logDir=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/WALs/jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:02:57,483 INFO [RS:1;jenkins-hbase4:37181] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 06:02:57,483 DEBUG [RS:1;jenkins-hbase4:37181] regionserver.HRegionServer(1947): logDir=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/WALs/jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:02:57,484 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42183,1676181777167] 2023-02-12 06:02:57,484 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37181,1676181777204] 2023-02-12 06:02:57,492 DEBUG [RS:0;jenkins-hbase4:42183] zookeeper.ZKUtil(162): regionserver:42183-0x1004720144c0001, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:02:57,492 DEBUG [RS:1;jenkins-hbase4:37181] zookeeper.ZKUtil(162): regionserver:37181-0x1004720144c0002, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:02:57,492 DEBUG [RS:0;jenkins-hbase4:42183] zookeeper.ZKUtil(162): regionserver:42183-0x1004720144c0001, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:02:57,492 DEBUG [RS:1;jenkins-hbase4:37181] zookeeper.ZKUtil(162): regionserver:37181-0x1004720144c0002, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:02:57,493 DEBUG [RS:0;jenkins-hbase4:42183] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 06:02:57,493 DEBUG [RS:1;jenkins-hbase4:37181] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 06:02:57,493 INFO [RS:0;jenkins-hbase4:42183] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 06:02:57,494 INFO [RS:1;jenkins-hbase4:37181] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 06:02:57,495 INFO [RS:0;jenkins-hbase4:42183] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 06:02:57,500 INFO [RS:0;jenkins-hbase4:42183] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 06:02:57,500 INFO [RS:0;jenkins-hbase4:42183] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:57,500 INFO [RS:1;jenkins-hbase4:37181] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 06:02:57,500 INFO [RS:0;jenkins-hbase4:42183] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 06:02:57,503 INFO [RS:1;jenkins-hbase4:37181] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 06:02:57,503 INFO [RS:1;jenkins-hbase4:37181] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:57,503 INFO [RS:1;jenkins-hbase4:37181] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 06:02:57,504 INFO [RS:0;jenkins-hbase4:42183] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:57,504 DEBUG [RS:0;jenkins-hbase4:42183] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:02:57,504 DEBUG [RS:0;jenkins-hbase4:42183] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:02:57,504 DEBUG [RS:0;jenkins-hbase4:42183] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:02:57,504 INFO [RS:1;jenkins-hbase4:37181] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:57,504 DEBUG [RS:0;jenkins-hbase4:42183] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:02:57,505 DEBUG [RS:1;jenkins-hbase4:37181] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:02:57,505 DEBUG [RS:0;jenkins-hbase4:42183] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:02:57,505 DEBUG [RS:1;jenkins-hbase4:37181] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:02:57,505 DEBUG [RS:0;jenkins-hbase4:42183] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 06:02:57,505 DEBUG [RS:1;jenkins-hbase4:37181] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:02:57,505 DEBUG [RS:0;jenkins-hbase4:42183] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:02:57,505 DEBUG [RS:1;jenkins-hbase4:37181] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:02:57,505 DEBUG [RS:0;jenkins-hbase4:42183] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:02:57,505 DEBUG [RS:1;jenkins-hbase4:37181] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:02:57,505 DEBUG [RS:0;jenkins-hbase4:42183] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:02:57,505 DEBUG [RS:1;jenkins-hbase4:37181] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 06:02:57,505 DEBUG [RS:0;jenkins-hbase4:42183] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:02:57,505 DEBUG [RS:1;jenkins-hbase4:37181] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:02:57,506 DEBUG [RS:1;jenkins-hbase4:37181] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:02:57,506 DEBUG [RS:1;jenkins-hbase4:37181] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:02:57,506 DEBUG [RS:1;jenkins-hbase4:37181] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:02:57,512 INFO [RS:0;jenkins-hbase4:42183] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:57,512 INFO [RS:0;jenkins-hbase4:42183] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:57,512 INFO [RS:0;jenkins-hbase4:42183] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:57,513 INFO [RS:1;jenkins-hbase4:37181] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:57,513 INFO [RS:1;jenkins-hbase4:37181] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:57,513 INFO [RS:1;jenkins-hbase4:37181] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:57,530 INFO [RS:0;jenkins-hbase4:42183] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 06:02:57,530 INFO [RS:1;jenkins-hbase4:37181] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 06:02:57,530 INFO [RS:0;jenkins-hbase4:42183] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42183,1676181777167-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:57,530 INFO [RS:1;jenkins-hbase4:37181] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37181,1676181777204-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:57,550 INFO [RS:0;jenkins-hbase4:42183] regionserver.Replication(203): jenkins-hbase4.apache.org,42183,1676181777167 started 2023-02-12 06:02:57,550 INFO [RS:1;jenkins-hbase4:37181] regionserver.Replication(203): jenkins-hbase4.apache.org,37181,1676181777204 started 2023-02-12 06:02:57,550 INFO [RS:0;jenkins-hbase4:42183] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,42183,1676181777167, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42183, sessionid=0x1004720144c0001 2023-02-12 06:02:57,550 INFO [RS:1;jenkins-hbase4:37181] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,37181,1676181777204, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37181, sessionid=0x1004720144c0002 2023-02-12 06:02:57,550 DEBUG [RS:0;jenkins-hbase4:42183] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 06:02:57,550 DEBUG [RS:1;jenkins-hbase4:37181] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 06:02:57,550 DEBUG [RS:1;jenkins-hbase4:37181] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:02:57,550 DEBUG [RS:0;jenkins-hbase4:42183] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:02:57,551 DEBUG [RS:0;jenkins-hbase4:42183] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42183,1676181777167' 2023-02-12 06:02:57,551 DEBUG [RS:0;jenkins-hbase4:42183] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:02:57,551 DEBUG [RS:1;jenkins-hbase4:37181] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37181,1676181777204' 2023-02-12 06:02:57,551 DEBUG [RS:1;jenkins-hbase4:37181] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:02:57,551 DEBUG [RS:0;jenkins-hbase4:42183] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:02:57,551 DEBUG [RS:1;jenkins-hbase4:37181] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:02:57,552 DEBUG [RS:0;jenkins-hbase4:42183] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 06:02:57,552 DEBUG [RS:0;jenkins-hbase4:42183] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 06:02:57,552 DEBUG [RS:0;jenkins-hbase4:42183] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:02:57,552 DEBUG [RS:1;jenkins-hbase4:37181] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 06:02:57,552 DEBUG [RS:1;jenkins-hbase4:37181] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 06:02:57,552 DEBUG [RS:1;jenkins-hbase4:37181] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:02:57,552 DEBUG [RS:1;jenkins-hbase4:37181] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37181,1676181777204' 2023-02-12 06:02:57,552 DEBUG [RS:1;jenkins-hbase4:37181] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:02:57,552 DEBUG [RS:0;jenkins-hbase4:42183] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42183,1676181777167' 2023-02-12 06:02:57,552 DEBUG [RS:0;jenkins-hbase4:42183] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:02:57,552 DEBUG [RS:0;jenkins-hbase4:42183] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:02:57,553 DEBUG [RS:1;jenkins-hbase4:37181] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:02:57,553 DEBUG [RS:0;jenkins-hbase4:42183] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 06:02:57,553 INFO [RS:0;jenkins-hbase4:42183] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 06:02:57,553 INFO [RS:0;jenkins-hbase4:42183] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 06:02:57,553 DEBUG [RS:1;jenkins-hbase4:37181] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 06:02:57,553 INFO [RS:1;jenkins-hbase4:37181] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 06:02:57,553 INFO [RS:1;jenkins-hbase4:37181] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 06:02:57,632 DEBUG [jenkins-hbase4:45631] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-12 06:02:57,632 DEBUG [jenkins-hbase4:45631] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 06:02:57,634 DEBUG [jenkins-hbase4:45631] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 06:02:57,634 DEBUG [jenkins-hbase4:45631] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 06:02:57,635 DEBUG [jenkins-hbase4:45631] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 06:02:57,635 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37181,1676181777204, state=OPENING 2023-02-12 06:02:57,637 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-12 06:02:57,638 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:02:57,639 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 06:02:57,639 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37181,1676181777204}] 2023-02-12 06:02:57,793 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:02:57,794 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 06:02:57,796 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43804, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 06:02:57,801 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-12 06:02:57,801 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 06:02:57,802 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37181%2C1676181777204.meta, suffix=.meta, logDir=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/WALs/jenkins-hbase4.apache.org,37181,1676181777204, archiveDir=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/oldWALs, maxLogs=32 2023-02-12 06:02:57,820 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34227,DS-2fefe694-2ab8-4f6f-ac05-00b420e7b349,DISK] 2023-02-12 06:02:57,820 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40431,DS-cdcb23ac-f2b8-4f06-8bd5-2346dbe72385,DISK] 2023-02-12 06:02:57,827 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/WALs/jenkins-hbase4.apache.org,37181,1676181777204/jenkins-hbase4.apache.org%2C37181%2C1676181777204.meta.1676181777803.meta 2023-02-12 06:02:57,827 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34227,DS-2fefe694-2ab8-4f6f-ac05-00b420e7b349,DISK], DatanodeInfoWithStorage[127.0.0.1:40431,DS-cdcb23ac-f2b8-4f06-8bd5-2346dbe72385,DISK]] 2023-02-12 06:02:57,827 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-12 06:02:57,827 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-12 06:02:57,828 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-12 06:02:57,828 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-12 06:02:57,829 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-12 06:02:57,829 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:57,829 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-12 06:02:57,829 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-12 06:02:57,830 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 06:02:57,831 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/hbase/meta/1588230740/info 2023-02-12 06:02:57,831 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/hbase/meta/1588230740/info 2023-02-12 06:02:57,832 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 06:02:57,832 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:57,832 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 06:02:57,833 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/hbase/meta/1588230740/rep_barrier 2023-02-12 06:02:57,833 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/hbase/meta/1588230740/rep_barrier 2023-02-12 06:02:57,833 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 06:02:57,834 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:57,834 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 06:02:57,835 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/hbase/meta/1588230740/table 2023-02-12 06:02:57,835 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/hbase/meta/1588230740/table 2023-02-12 06:02:57,835 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 06:02:57,835 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:57,836 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/hbase/meta/1588230740 2023-02-12 06:02:57,837 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/hbase/meta/1588230740 2023-02-12 06:02:57,839 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 06:02:57,840 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 06:02:57,841 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72955719, jitterRate=0.08712492883205414}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 06:02:57,842 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676181777829Writing region info on filesystem at 1676181777829Initializing all the Stores at 1676181777830 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676181777830Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181777830Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676181777830Cleaning up temporary data from old regions at 1676181777838 (+8 ms)Cleaning up detritus from prior splits at 1676181777838Running coprocessor post-open hooks at 1676181777842 (+4 ms)Region opened successfully at 1676181777842 2023-02-12 06:02:57,843 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676181777793 2023-02-12 06:02:57,847 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-12 06:02:57,847 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-12 06:02:57,848 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37181,1676181777204, state=OPEN 2023-02-12 06:02:57,851 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-12 06:02:57,851 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 06:02:57,853 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-12 06:02:57,853 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37181,1676181777204 in 212 msec 2023-02-12 06:02:57,855 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-12 06:02:57,855 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 376 msec 2023-02-12 06:02:57,857 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 460 msec 2023-02-12 06:02:57,857 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676181777238, completionTime=-1 2023-02-12 06:02:57,857 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-12 06:02:57,857 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-12 06:02:57,860 DEBUG [hconnection-0x532283a8-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 06:02:57,862 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43812, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 06:02:57,863 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-12 06:02:57,864 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676181837864 2023-02-12 06:02:57,864 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676181897864 2023-02-12 06:02:57,864 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-12 06:02:57,872 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45631,1676181777071-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:57,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45631,1676181777071-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:57,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45631,1676181777071-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:57,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:45631, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:57,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-12 06:02:57,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-12 06:02:57,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 06:02:57,874 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-12 06:02:57,875 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-12 06:02:57,876 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 06:02:57,877 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 06:02:57,879 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp/data/hbase/namespace/70962f2f424e7a6feeef8d88d58ef25d 2023-02-12 06:02:57,880 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp/data/hbase/namespace/70962f2f424e7a6feeef8d88d58ef25d empty. 2023-02-12 06:02:57,880 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp/data/hbase/namespace/70962f2f424e7a6feeef8d88d58ef25d 2023-02-12 06:02:57,881 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-12 06:02:57,900 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-12 06:02:57,901 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 70962f2f424e7a6feeef8d88d58ef25d, NAME => 'hbase:namespace,,1676181777873.70962f2f424e7a6feeef8d88d58ef25d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp 2023-02-12 06:02:57,914 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676181777873.70962f2f424e7a6feeef8d88d58ef25d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:57,915 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 70962f2f424e7a6feeef8d88d58ef25d, disabling compactions & flushes 2023-02-12 06:02:57,915 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676181777873.70962f2f424e7a6feeef8d88d58ef25d. 2023-02-12 06:02:57,915 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676181777873.70962f2f424e7a6feeef8d88d58ef25d. 2023-02-12 06:02:57,915 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676181777873.70962f2f424e7a6feeef8d88d58ef25d. after waiting 0 ms 2023-02-12 06:02:57,915 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676181777873.70962f2f424e7a6feeef8d88d58ef25d. 2023-02-12 06:02:57,915 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676181777873.70962f2f424e7a6feeef8d88d58ef25d. 2023-02-12 06:02:57,915 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 70962f2f424e7a6feeef8d88d58ef25d: Waiting for close lock at 1676181777915Disabling compacts and flushes for region at 1676181777915Disabling writes for close at 1676181777915Writing region close event to WAL at 1676181777915Closed at 1676181777915 2023-02-12 06:02:57,918 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 06:02:57,919 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676181777873.70962f2f424e7a6feeef8d88d58ef25d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676181777919"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181777919"}]},"ts":"1676181777919"} 2023-02-12 06:02:57,922 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 06:02:57,928 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 06:02:57,929 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676181777928"}]},"ts":"1676181777928"} 2023-02-12 06:02:57,930 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-12 06:02:57,934 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 06:02:57,935 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 06:02:57,935 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 06:02:57,935 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 06:02:57,935 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=70962f2f424e7a6feeef8d88d58ef25d, ASSIGN}] 2023-02-12 06:02:57,938 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=70962f2f424e7a6feeef8d88d58ef25d, ASSIGN 2023-02-12 06:02:57,939 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=70962f2f424e7a6feeef8d88d58ef25d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42183,1676181777167; forceNewPlan=false, retain=false 2023-02-12 06:02:58,089 INFO [jenkins-hbase4:45631] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 06:02:58,090 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=70962f2f424e7a6feeef8d88d58ef25d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:02:58,090 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676181777873.70962f2f424e7a6feeef8d88d58ef25d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676181778090"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181778090"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181778090"}]},"ts":"1676181778090"} 2023-02-12 06:02:58,093 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 70962f2f424e7a6feeef8d88d58ef25d, server=jenkins-hbase4.apache.org,42183,1676181777167}] 2023-02-12 06:02:58,246 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:02:58,246 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 06:02:58,249 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37376, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 06:02:58,253 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676181777873.70962f2f424e7a6feeef8d88d58ef25d. 2023-02-12 06:02:58,254 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42183%2C1676181777167, suffix=, logDir=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/WALs/jenkins-hbase4.apache.org,42183,1676181777167, archiveDir=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/oldWALs, maxLogs=32 2023-02-12 06:02:58,271 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34227,DS-2fefe694-2ab8-4f6f-ac05-00b420e7b349,DISK] 2023-02-12 06:02:58,271 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40431,DS-cdcb23ac-f2b8-4f06-8bd5-2346dbe72385,DISK] 2023-02-12 06:02:58,273 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/WALs/jenkins-hbase4.apache.org,42183,1676181777167/jenkins-hbase4.apache.org%2C42183%2C1676181777167.1676181778255 2023-02-12 06:02:58,274 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34227,DS-2fefe694-2ab8-4f6f-ac05-00b420e7b349,DISK], DatanodeInfoWithStorage[127.0.0.1:40431,DS-cdcb23ac-f2b8-4f06-8bd5-2346dbe72385,DISK]] 2023-02-12 06:02:58,274 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 70962f2f424e7a6feeef8d88d58ef25d, NAME => 'hbase:namespace,,1676181777873.70962f2f424e7a6feeef8d88d58ef25d.', STARTKEY => '', ENDKEY => ''} 2023-02-12 06:02:58,274 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 70962f2f424e7a6feeef8d88d58ef25d 2023-02-12 06:02:58,274 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676181777873.70962f2f424e7a6feeef8d88d58ef25d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:58,274 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 70962f2f424e7a6feeef8d88d58ef25d 2023-02-12 06:02:58,274 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 70962f2f424e7a6feeef8d88d58ef25d 2023-02-12 06:02:58,275 INFO [StoreOpener-70962f2f424e7a6feeef8d88d58ef25d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 70962f2f424e7a6feeef8d88d58ef25d 2023-02-12 06:02:58,277 DEBUG [StoreOpener-70962f2f424e7a6feeef8d88d58ef25d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/hbase/namespace/70962f2f424e7a6feeef8d88d58ef25d/info 2023-02-12 06:02:58,277 DEBUG [StoreOpener-70962f2f424e7a6feeef8d88d58ef25d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/hbase/namespace/70962f2f424e7a6feeef8d88d58ef25d/info 2023-02-12 06:02:58,277 INFO [StoreOpener-70962f2f424e7a6feeef8d88d58ef25d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 70962f2f424e7a6feeef8d88d58ef25d columnFamilyName info 2023-02-12 06:02:58,278 INFO [StoreOpener-70962f2f424e7a6feeef8d88d58ef25d-1] regionserver.HStore(310): Store=70962f2f424e7a6feeef8d88d58ef25d/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:58,279 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/hbase/namespace/70962f2f424e7a6feeef8d88d58ef25d 2023-02-12 06:02:58,279 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/hbase/namespace/70962f2f424e7a6feeef8d88d58ef25d 2023-02-12 06:02:58,282 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 70962f2f424e7a6feeef8d88d58ef25d 2023-02-12 06:02:58,283 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/hbase/namespace/70962f2f424e7a6feeef8d88d58ef25d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:02:58,284 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 70962f2f424e7a6feeef8d88d58ef25d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75449170, jitterRate=0.12428024411201477}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 06:02:58,284 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 70962f2f424e7a6feeef8d88d58ef25d: Running coprocessor pre-open hook at 1676181778274Writing region info on filesystem at 1676181778274Initializing all the Stores at 1676181778275 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676181778275Cleaning up temporary data from old regions at 1676181778280 (+5 ms)Cleaning up detritus from prior splits at 1676181778280Running coprocessor post-open hooks at 1676181778284 (+4 ms)Region opened successfully at 1676181778284 2023-02-12 06:02:58,285 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676181777873.70962f2f424e7a6feeef8d88d58ef25d., pid=6, masterSystemTime=1676181778245 2023-02-12 06:02:58,289 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676181777873.70962f2f424e7a6feeef8d88d58ef25d. 2023-02-12 06:02:58,289 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676181777873.70962f2f424e7a6feeef8d88d58ef25d. 2023-02-12 06:02:58,290 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=70962f2f424e7a6feeef8d88d58ef25d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:02:58,290 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676181777873.70962f2f424e7a6feeef8d88d58ef25d.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676181778290"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676181778290"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676181778290"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676181778290"}]},"ts":"1676181778290"} 2023-02-12 06:02:58,294 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-12 06:02:58,294 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 70962f2f424e7a6feeef8d88d58ef25d, server=jenkins-hbase4.apache.org,42183,1676181777167 in 199 msec 2023-02-12 06:02:58,296 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-12 06:02:58,296 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=70962f2f424e7a6feeef8d88d58ef25d, ASSIGN in 359 msec 2023-02-12 06:02:58,297 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 06:02:58,297 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676181778297"}]},"ts":"1676181778297"} 2023-02-12 06:02:58,298 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-12 06:02:58,300 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 06:02:58,302 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 428 msec 2023-02-12 06:02:58,375 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-12 06:02:58,377 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-12 06:02:58,377 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:02:58,380 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 06:02:58,383 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37386, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 06:02:58,385 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-12 06:02:58,394 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 06:02:58,398 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 13 msec 2023-02-12 06:02:58,407 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-12 06:02:58,414 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 06:02:58,416 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-12 06:02:58,422 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-12 06:02:58,424 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-12 06:02:58,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.180sec 2023-02-12 06:02:58,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-12 06:02:58,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-12 06:02:58,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-12 06:02:58,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45631,1676181777071-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-12 06:02:58,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45631,1676181777071-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-12 06:02:58,426 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-12 06:02:58,431 DEBUG [Listener at localhost/40063] zookeeper.ReadOnlyZKClient(139): Connect 0x4f070997 to 127.0.0.1:61935 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 06:02:58,435 DEBUG [Listener at localhost/40063] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f271f07, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 06:02:58,436 DEBUG [hconnection-0x3bcfe385-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 06:02:58,440 INFO [RS-EventLoopGroup-8-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43814, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 06:02:58,441 INFO [Listener at localhost/40063] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,45631,1676181777071 2023-02-12 06:02:58,442 DEBUG [Listener at localhost/40063] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-12 06:02:58,443 DEBUG [Listener at localhost/40063] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 06:02:58,445 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48392, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 06:02:58,445 INFO [Listener at localhost/40063] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-12 06:02:58,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45631] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-12 06:02:58,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45631] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-12 06:02:58,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45631] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 76 connection: 172.31.14.131:48392 deadline: 1676181838446, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-12 06:02:58,447 INFO [Listener at localhost/40063] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-12 06:02:58,449 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45631] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 06:02:58,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45631] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-12 06:02:58,452 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 06:02:58,452 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45631] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-12 06:02:58,453 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 06:02:58,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45631] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 06:02:58,462 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp/data/default/testWithMapReduce/67a4fa90e2183d009f14b0952284dab6 2023-02-12 06:02:58,462 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp/data/default/testWithMapReduce/1d974d28b432221ca9ffde441bf98fb2 2023-02-12 06:02:58,462 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp/data/default/testWithMapReduce/0791c9d76ddc855936e4dac63b936fe3 2023-02-12 06:02:58,462 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp/data/default/testWithMapReduce/bc33ffcdfaec411e24236b6d44e5db2b 2023-02-12 06:02:58,462 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp/data/default/testWithMapReduce/7db93b0592a0ffbad72426a53dea531d 2023-02-12 06:02:58,462 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp/data/default/testWithMapReduce/5196f1f5c7fff2336111d751c7d841e2 2023-02-12 06:02:58,462 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp/data/default/testWithMapReduce/c208c138f9bebfcad824fa3fbb7e912a 2023-02-12 06:02:58,463 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp/data/default/testWithMapReduce/67a4fa90e2183d009f14b0952284dab6 empty. 2023-02-12 06:02:58,463 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp/data/default/testWithMapReduce/bc33ffcdfaec411e24236b6d44e5db2b empty. 2023-02-12 06:02:58,462 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp/data/default/testWithMapReduce/96e1fed3c51e76d3db58034d221e5500 2023-02-12 06:02:58,463 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp/data/default/testWithMapReduce/1d974d28b432221ca9ffde441bf98fb2 empty. 2023-02-12 06:02:58,463 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp/data/default/testWithMapReduce/7db93b0592a0ffbad72426a53dea531d empty. 2023-02-12 06:02:58,463 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp/data/default/testWithMapReduce/5196f1f5c7fff2336111d751c7d841e2 empty. 2023-02-12 06:02:58,463 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp/data/default/testWithMapReduce/c208c138f9bebfcad824fa3fbb7e912a empty. 2023-02-12 06:02:58,464 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp/data/default/testWithMapReduce/7db93b0592a0ffbad72426a53dea531d 2023-02-12 06:02:58,464 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp/data/default/testWithMapReduce/ac4bbab435a2c040bbdb8338c993e6ec 2023-02-12 06:02:58,464 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp/data/default/testWithMapReduce/c208c138f9bebfcad824fa3fbb7e912a 2023-02-12 06:02:58,464 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp/data/default/testWithMapReduce/ec61a0ee1596767b26f9746acbc2e507 2023-02-12 06:02:58,464 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp/data/default/testWithMapReduce/ac4bbab435a2c040bbdb8338c993e6ec empty. 2023-02-12 06:02:58,464 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp/data/default/testWithMapReduce/ec61a0ee1596767b26f9746acbc2e507 empty. 2023-02-12 06:02:58,464 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp/data/default/testWithMapReduce/0791c9d76ddc855936e4dac63b936fe3 empty. 2023-02-12 06:02:58,464 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp/data/default/testWithMapReduce/ac4bbab435a2c040bbdb8338c993e6ec 2023-02-12 06:02:58,465 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp/data/default/testWithMapReduce/5196f1f5c7fff2336111d751c7d841e2 2023-02-12 06:02:58,465 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp/data/default/testWithMapReduce/ec61a0ee1596767b26f9746acbc2e507 2023-02-12 06:02:58,465 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp/data/default/testWithMapReduce/1d974d28b432221ca9ffde441bf98fb2 2023-02-12 06:02:58,465 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp/data/default/testWithMapReduce/96e1fed3c51e76d3db58034d221e5500 empty. 2023-02-12 06:02:58,465 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp/data/default/testWithMapReduce/bc33ffcdfaec411e24236b6d44e5db2b 2023-02-12 06:02:58,465 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp/data/default/testWithMapReduce/67a4fa90e2183d009f14b0952284dab6 2023-02-12 06:02:58,465 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp/data/default/testWithMapReduce/0791c9d76ddc855936e4dac63b936fe3 2023-02-12 06:02:58,465 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp/data/default/testWithMapReduce/96e1fed3c51e76d3db58034d221e5500 2023-02-12 06:02:58,465 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-12 06:02:58,476 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-12 06:02:58,478 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => c208c138f9bebfcad824fa3fbb7e912a, NAME => 'testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp 2023-02-12 06:02:58,478 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 67a4fa90e2183d009f14b0952284dab6, NAME => 'testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp 2023-02-12 06:02:58,478 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 96e1fed3c51e76d3db58034d221e5500, NAME => 'testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp 2023-02-12 06:02:58,500 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:58,500 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 96e1fed3c51e76d3db58034d221e5500, disabling compactions & flushes 2023-02-12 06:02:58,500 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500. 2023-02-12 06:02:58,500 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500. 2023-02-12 06:02:58,500 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500. after waiting 0 ms 2023-02-12 06:02:58,500 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500. 2023-02-12 06:02:58,500 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500. 2023-02-12 06:02:58,500 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 96e1fed3c51e76d3db58034d221e5500: Waiting for close lock at 1676181778500Disabling compacts and flushes for region at 1676181778500Disabling writes for close at 1676181778500Writing region close event to WAL at 1676181778500Closed at 1676181778500 2023-02-12 06:02:58,501 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 5196f1f5c7fff2336111d751c7d841e2, NAME => 'testWithMapReduce,g\xA7\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp 2023-02-12 06:02:58,507 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:58,508 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 67a4fa90e2183d009f14b0952284dab6, disabling compactions & flushes 2023-02-12 06:02:58,508 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6. 2023-02-12 06:02:58,508 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6. 2023-02-12 06:02:58,508 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6. after waiting 0 ms 2023-02-12 06:02:58,508 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6. 2023-02-12 06:02:58,508 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6. 2023-02-12 06:02:58,508 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 67a4fa90e2183d009f14b0952284dab6: Waiting for close lock at 1676181778508Disabling compacts and flushes for region at 1676181778508Disabling writes for close at 1676181778508Writing region close event to WAL at 1676181778508Closed at 1676181778508 2023-02-12 06:02:58,509 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 1d974d28b432221ca9ffde441bf98fb2, NAME => 'testWithMapReduce,j\xCA\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp 2023-02-12 06:02:58,512 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:58,513 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 5196f1f5c7fff2336111d751c7d841e2, disabling compactions & flushes 2023-02-12 06:02:58,513 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2. 2023-02-12 06:02:58,513 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2. 2023-02-12 06:02:58,513 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2. after waiting 0 ms 2023-02-12 06:02:58,513 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2. 2023-02-12 06:02:58,513 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2. 2023-02-12 06:02:58,513 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 5196f1f5c7fff2336111d751c7d841e2: Waiting for close lock at 1676181778513Disabling compacts and flushes for region at 1676181778513Disabling writes for close at 1676181778513Writing region close event to WAL at 1676181778513Closed at 1676181778513 2023-02-12 06:02:58,513 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 7db93b0592a0ffbad72426a53dea531d, NAME => 'testWithMapReduce,m\xED\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp 2023-02-12 06:02:58,520 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:58,520 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 1d974d28b432221ca9ffde441bf98fb2, disabling compactions & flushes 2023-02-12 06:02:58,520 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2. 2023-02-12 06:02:58,520 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2. 2023-02-12 06:02:58,520 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2. after waiting 0 ms 2023-02-12 06:02:58,520 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2. 2023-02-12 06:02:58,520 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2. 2023-02-12 06:02:58,520 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 1d974d28b432221ca9ffde441bf98fb2: Waiting for close lock at 1676181778520Disabling compacts and flushes for region at 1676181778520Disabling writes for close at 1676181778520Writing region close event to WAL at 1676181778520Closed at 1676181778520 2023-02-12 06:02:58,521 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => bc33ffcdfaec411e24236b6d44e5db2b, NAME => 'testWithMapReduce,q\x11\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp 2023-02-12 06:02:58,526 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:58,527 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 7db93b0592a0ffbad72426a53dea531d, disabling compactions & flushes 2023-02-12 06:02:58,527 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d. 2023-02-12 06:02:58,527 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d. 2023-02-12 06:02:58,527 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d. after waiting 0 ms 2023-02-12 06:02:58,527 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d. 2023-02-12 06:02:58,527 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d. 2023-02-12 06:02:58,527 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 7db93b0592a0ffbad72426a53dea531d: Waiting for close lock at 1676181778527Disabling compacts and flushes for region at 1676181778527Disabling writes for close at 1676181778527Writing region close event to WAL at 1676181778527Closed at 1676181778527 2023-02-12 06:02:58,527 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 0791c9d76ddc855936e4dac63b936fe3, NAME => 'testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp 2023-02-12 06:02:58,530 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:58,530 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing bc33ffcdfaec411e24236b6d44e5db2b, disabling compactions & flushes 2023-02-12 06:02:58,530 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b. 2023-02-12 06:02:58,530 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b. 2023-02-12 06:02:58,530 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b. after waiting 0 ms 2023-02-12 06:02:58,530 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b. 2023-02-12 06:02:58,530 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b. 2023-02-12 06:02:58,530 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for bc33ffcdfaec411e24236b6d44e5db2b: Waiting for close lock at 1676181778530Disabling compacts and flushes for region at 1676181778530Disabling writes for close at 1676181778530Writing region close event to WAL at 1676181778530Closed at 1676181778530 2023-02-12 06:02:58,530 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => ac4bbab435a2c040bbdb8338c993e6ec, NAME => 'testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp 2023-02-12 06:02:58,535 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:58,535 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 0791c9d76ddc855936e4dac63b936fe3, disabling compactions & flushes 2023-02-12 06:02:58,535 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3. 2023-02-12 06:02:58,535 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3. 2023-02-12 06:02:58,535 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3. after waiting 0 ms 2023-02-12 06:02:58,535 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3. 2023-02-12 06:02:58,535 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3. 2023-02-12 06:02:58,535 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 0791c9d76ddc855936e4dac63b936fe3: Waiting for close lock at 1676181778535Disabling compacts and flushes for region at 1676181778535Disabling writes for close at 1676181778535Writing region close event to WAL at 1676181778535Closed at 1676181778535 2023-02-12 06:02:58,535 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => ec61a0ee1596767b26f9746acbc2e507, NAME => 'testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.tmp 2023-02-12 06:02:58,538 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:58,538 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing ac4bbab435a2c040bbdb8338c993e6ec, disabling compactions & flushes 2023-02-12 06:02:58,538 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec. 2023-02-12 06:02:58,538 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec. 2023-02-12 06:02:58,538 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec. after waiting 0 ms 2023-02-12 06:02:58,538 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec. 2023-02-12 06:02:58,538 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec. 2023-02-12 06:02:58,538 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for ac4bbab435a2c040bbdb8338c993e6ec: Waiting for close lock at 1676181778538Disabling compacts and flushes for region at 1676181778538Disabling writes for close at 1676181778538Writing region close event to WAL at 1676181778538Closed at 1676181778538 2023-02-12 06:02:58,542 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:58,543 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing ec61a0ee1596767b26f9746acbc2e507, disabling compactions & flushes 2023-02-12 06:02:58,543 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507. 2023-02-12 06:02:58,543 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507. 2023-02-12 06:02:58,543 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507. after waiting 0 ms 2023-02-12 06:02:58,543 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507. 2023-02-12 06:02:58,543 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507. 2023-02-12 06:02:58,543 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for ec61a0ee1596767b26f9746acbc2e507: Waiting for close lock at 1676181778543Disabling compacts and flushes for region at 1676181778543Disabling writes for close at 1676181778543Writing region close event to WAL at 1676181778543Closed at 1676181778543 2023-02-12 06:02:58,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45631] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 06:02:58,556 INFO [RS:1;jenkins-hbase4:37181] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37181%2C1676181777204, suffix=, logDir=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/WALs/jenkins-hbase4.apache.org,37181,1676181777204, archiveDir=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/oldWALs, maxLogs=32 2023-02-12 06:02:58,571 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40431,DS-cdcb23ac-f2b8-4f06-8bd5-2346dbe72385,DISK] 2023-02-12 06:02:58,571 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34227,DS-2fefe694-2ab8-4f6f-ac05-00b420e7b349,DISK] 2023-02-12 06:02:58,574 INFO [RS:1;jenkins-hbase4:37181] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/WALs/jenkins-hbase4.apache.org,37181,1676181777204/jenkins-hbase4.apache.org%2C37181%2C1676181777204.1676181778556 2023-02-12 06:02:58,574 DEBUG [RS:1;jenkins-hbase4:37181] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40431,DS-cdcb23ac-f2b8-4f06-8bd5-2346dbe72385,DISK], DatanodeInfoWithStorage[127.0.0.1:34227,DS-2fefe694-2ab8-4f6f-ac05-00b420e7b349,DISK]] 2023-02-12 06:02:58,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45631] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 06:02:58,903 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:58,903 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing c208c138f9bebfcad824fa3fbb7e912a, disabling compactions & flushes 2023-02-12 06:02:58,903 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a. 2023-02-12 06:02:58,903 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a. 2023-02-12 06:02:58,903 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a. after waiting 0 ms 2023-02-12 06:02:58,903 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a. 2023-02-12 06:02:58,903 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a. 2023-02-12 06:02:58,903 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for c208c138f9bebfcad824fa3fbb7e912a: Waiting for close lock at 1676181778903Disabling compacts and flushes for region at 1676181778903Disabling writes for close at 1676181778903Writing region close event to WAL at 1676181778903Closed at 1676181778903 2023-02-12 06:02:58,906 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 06:02:58,907 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181778907"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181778907"}]},"ts":"1676181778907"} 2023-02-12 06:02:58,907 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676181778907"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181778907"}]},"ts":"1676181778907"} 2023-02-12 06:02:58,907 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181778907"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181778907"}]},"ts":"1676181778907"} 2023-02-12 06:02:58,907 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181778907"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181778907"}]},"ts":"1676181778907"} 2023-02-12 06:02:58,907 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181778907"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181778907"}]},"ts":"1676181778907"} 2023-02-12 06:02:58,907 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181778907"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181778907"}]},"ts":"1676181778907"} 2023-02-12 06:02:58,907 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181778907"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181778907"}]},"ts":"1676181778907"} 2023-02-12 06:02:58,907 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181778907"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181778907"}]},"ts":"1676181778907"} 2023-02-12 06:02:58,907 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676181778907"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181778907"}]},"ts":"1676181778907"} 2023-02-12 06:02:58,908 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181778907"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181778907"}]},"ts":"1676181778907"} 2023-02-12 06:02:58,911 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-12 06:02:58,912 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 06:02:58,912 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676181778912"}]},"ts":"1676181778912"} 2023-02-12 06:02:58,914 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-12 06:02:58,918 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 06:02:58,926 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 06:02:58,926 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 06:02:58,926 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 06:02:58,927 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=67a4fa90e2183d009f14b0952284dab6, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c208c138f9bebfcad824fa3fbb7e912a, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=96e1fed3c51e76d3db58034d221e5500, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5196f1f5c7fff2336111d751c7d841e2, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1d974d28b432221ca9ffde441bf98fb2, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7db93b0592a0ffbad72426a53dea531d, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=bc33ffcdfaec411e24236b6d44e5db2b, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0791c9d76ddc855936e4dac63b936fe3, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ac4bbab435a2c040bbdb8338c993e6ec, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ec61a0ee1596767b26f9746acbc2e507, ASSIGN}] 2023-02-12 06:02:58,929 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=bc33ffcdfaec411e24236b6d44e5db2b, ASSIGN 2023-02-12 06:02:58,929 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0791c9d76ddc855936e4dac63b936fe3, ASSIGN 2023-02-12 06:02:58,930 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7db93b0592a0ffbad72426a53dea531d, ASSIGN 2023-02-12 06:02:58,930 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ac4bbab435a2c040bbdb8338c993e6ec, ASSIGN 2023-02-12 06:02:58,930 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ec61a0ee1596767b26f9746acbc2e507, ASSIGN 2023-02-12 06:02:58,930 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=0791c9d76ddc855936e4dac63b936fe3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42183,1676181777167; forceNewPlan=false, retain=false 2023-02-12 06:02:58,930 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=bc33ffcdfaec411e24236b6d44e5db2b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37181,1676181777204; forceNewPlan=false, retain=false 2023-02-12 06:02:58,931 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=7db93b0592a0ffbad72426a53dea531d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42183,1676181777167; forceNewPlan=false, retain=false 2023-02-12 06:02:58,931 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=ac4bbab435a2c040bbdb8338c993e6ec, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37181,1676181777204; forceNewPlan=false, retain=false 2023-02-12 06:02:58,931 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=ec61a0ee1596767b26f9746acbc2e507, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42183,1676181777167; forceNewPlan=false, retain=false 2023-02-12 06:02:58,932 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=1d974d28b432221ca9ffde441bf98fb2, ASSIGN 2023-02-12 06:02:58,932 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5196f1f5c7fff2336111d751c7d841e2, ASSIGN 2023-02-12 06:02:58,932 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=96e1fed3c51e76d3db58034d221e5500, ASSIGN 2023-02-12 06:02:58,932 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=c208c138f9bebfcad824fa3fbb7e912a, ASSIGN 2023-02-12 06:02:58,932 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=67a4fa90e2183d009f14b0952284dab6, ASSIGN 2023-02-12 06:02:58,933 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=1d974d28b432221ca9ffde441bf98fb2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37181,1676181777204; forceNewPlan=false, retain=false 2023-02-12 06:02:58,933 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=96e1fed3c51e76d3db58034d221e5500, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42183,1676181777167; forceNewPlan=false, retain=false 2023-02-12 06:02:58,933 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=5196f1f5c7fff2336111d751c7d841e2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42183,1676181777167; forceNewPlan=false, retain=false 2023-02-12 06:02:58,933 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=c208c138f9bebfcad824fa3fbb7e912a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37181,1676181777204; forceNewPlan=false, retain=false 2023-02-12 06:02:58,933 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=67a4fa90e2183d009f14b0952284dab6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37181,1676181777204; forceNewPlan=false, retain=false 2023-02-12 06:02:59,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45631] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 06:02:59,081 INFO [jenkins-hbase4:45631] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-12 06:02:59,084 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=5196f1f5c7fff2336111d751c7d841e2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:02:59,084 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=ec61a0ee1596767b26f9746acbc2e507, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:02:59,084 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=7db93b0592a0ffbad72426a53dea531d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:02:59,084 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=0791c9d76ddc855936e4dac63b936fe3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:02:59,084 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=96e1fed3c51e76d3db58034d221e5500, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:02:59,085 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181779084"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181779084"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181779084"}]},"ts":"1676181779084"} 2023-02-12 06:02:59,085 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181779084"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181779084"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181779084"}]},"ts":"1676181779084"} 2023-02-12 06:02:59,085 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676181779084"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181779084"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181779084"}]},"ts":"1676181779084"} 2023-02-12 06:02:59,085 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181779084"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181779084"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181779084"}]},"ts":"1676181779084"} 2023-02-12 06:02:59,085 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181779084"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181779084"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181779084"}]},"ts":"1676181779084"} 2023-02-12 06:02:59,087 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=16, state=RUNNABLE; OpenRegionProcedure 7db93b0592a0ffbad72426a53dea531d, server=jenkins-hbase4.apache.org,42183,1676181777167}] 2023-02-12 06:02:59,088 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=18, state=RUNNABLE; OpenRegionProcedure 0791c9d76ddc855936e4dac63b936fe3, server=jenkins-hbase4.apache.org,42183,1676181777167}] 2023-02-12 06:02:59,089 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=20, state=RUNNABLE; OpenRegionProcedure ec61a0ee1596767b26f9746acbc2e507, server=jenkins-hbase4.apache.org,42183,1676181777167}] 2023-02-12 06:02:59,091 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=14, state=RUNNABLE; OpenRegionProcedure 5196f1f5c7fff2336111d751c7d841e2, server=jenkins-hbase4.apache.org,42183,1676181777167}] 2023-02-12 06:02:59,091 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=13, state=RUNNABLE; OpenRegionProcedure 96e1fed3c51e76d3db58034d221e5500, server=jenkins-hbase4.apache.org,42183,1676181777167}] 2023-02-12 06:02:59,092 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=ac4bbab435a2c040bbdb8338c993e6ec, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:02:59,092 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181779092"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181779092"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181779092"}]},"ts":"1676181779092"} 2023-02-12 06:02:59,093 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=1d974d28b432221ca9ffde441bf98fb2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:02:59,093 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181779092"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181779092"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181779092"}]},"ts":"1676181779092"} 2023-02-12 06:02:59,094 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=c208c138f9bebfcad824fa3fbb7e912a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:02:59,094 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181779094"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181779094"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181779094"}]},"ts":"1676181779094"} 2023-02-12 06:02:59,096 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=19, state=RUNNABLE; OpenRegionProcedure ac4bbab435a2c040bbdb8338c993e6ec, server=jenkins-hbase4.apache.org,37181,1676181777204}] 2023-02-12 06:02:59,097 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=67a4fa90e2183d009f14b0952284dab6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:02:59,097 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676181779097"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181779097"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181779097"}]},"ts":"1676181779097"} 2023-02-12 06:02:59,097 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=15, state=RUNNABLE; OpenRegionProcedure 1d974d28b432221ca9ffde441bf98fb2, server=jenkins-hbase4.apache.org,37181,1676181777204}] 2023-02-12 06:02:59,098 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=12, state=RUNNABLE; OpenRegionProcedure c208c138f9bebfcad824fa3fbb7e912a, server=jenkins-hbase4.apache.org,37181,1676181777204}] 2023-02-12 06:02:59,099 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=bc33ffcdfaec411e24236b6d44e5db2b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:02:59,099 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181779099"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181779099"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181779099"}]},"ts":"1676181779099"} 2023-02-12 06:02:59,100 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=11, state=RUNNABLE; OpenRegionProcedure 67a4fa90e2183d009f14b0952284dab6, server=jenkins-hbase4.apache.org,37181,1676181777204}] 2023-02-12 06:02:59,101 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=17, state=RUNNABLE; OpenRegionProcedure bc33ffcdfaec411e24236b6d44e5db2b, server=jenkins-hbase4.apache.org,37181,1676181777204}] 2023-02-12 06:02:59,243 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d. 2023-02-12 06:02:59,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7db93b0592a0ffbad72426a53dea531d, NAME => 'testWithMapReduce,m\xED\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-12 06:02:59,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 7db93b0592a0ffbad72426a53dea531d 2023-02-12 06:02:59,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:59,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7db93b0592a0ffbad72426a53dea531d 2023-02-12 06:02:59,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7db93b0592a0ffbad72426a53dea531d 2023-02-12 06:02:59,245 INFO [StoreOpener-7db93b0592a0ffbad72426a53dea531d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7db93b0592a0ffbad72426a53dea531d 2023-02-12 06:02:59,246 DEBUG [StoreOpener-7db93b0592a0ffbad72426a53dea531d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/7db93b0592a0ffbad72426a53dea531d/f1 2023-02-12 06:02:59,247 DEBUG [StoreOpener-7db93b0592a0ffbad72426a53dea531d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/7db93b0592a0ffbad72426a53dea531d/f1 2023-02-12 06:02:59,247 INFO [StoreOpener-7db93b0592a0ffbad72426a53dea531d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7db93b0592a0ffbad72426a53dea531d columnFamilyName f1 2023-02-12 06:02:59,247 INFO [StoreOpener-7db93b0592a0ffbad72426a53dea531d-1] regionserver.HStore(310): Store=7db93b0592a0ffbad72426a53dea531d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:59,247 INFO [StoreOpener-7db93b0592a0ffbad72426a53dea531d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7db93b0592a0ffbad72426a53dea531d 2023-02-12 06:02:59,249 DEBUG [StoreOpener-7db93b0592a0ffbad72426a53dea531d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/7db93b0592a0ffbad72426a53dea531d/f2 2023-02-12 06:02:59,249 DEBUG [StoreOpener-7db93b0592a0ffbad72426a53dea531d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/7db93b0592a0ffbad72426a53dea531d/f2 2023-02-12 06:02:59,249 INFO [StoreOpener-7db93b0592a0ffbad72426a53dea531d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7db93b0592a0ffbad72426a53dea531d columnFamilyName f2 2023-02-12 06:02:59,250 INFO [StoreOpener-7db93b0592a0ffbad72426a53dea531d-1] regionserver.HStore(310): Store=7db93b0592a0ffbad72426a53dea531d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:59,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/7db93b0592a0ffbad72426a53dea531d 2023-02-12 06:02:59,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/7db93b0592a0ffbad72426a53dea531d 2023-02-12 06:02:59,252 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6. 2023-02-12 06:02:59,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 67a4fa90e2183d009f14b0952284dab6, NAME => 'testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-12 06:02:59,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 67a4fa90e2183d009f14b0952284dab6 2023-02-12 06:02:59,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:59,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 67a4fa90e2183d009f14b0952284dab6 2023-02-12 06:02:59,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:02:59,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 67a4fa90e2183d009f14b0952284dab6 2023-02-12 06:02:59,254 INFO [StoreOpener-67a4fa90e2183d009f14b0952284dab6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 67a4fa90e2183d009f14b0952284dab6 2023-02-12 06:02:59,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7db93b0592a0ffbad72426a53dea531d 2023-02-12 06:02:59,255 DEBUG [StoreOpener-67a4fa90e2183d009f14b0952284dab6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/67a4fa90e2183d009f14b0952284dab6/f1 2023-02-12 06:02:59,255 DEBUG [StoreOpener-67a4fa90e2183d009f14b0952284dab6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/67a4fa90e2183d009f14b0952284dab6/f1 2023-02-12 06:02:59,256 INFO [StoreOpener-67a4fa90e2183d009f14b0952284dab6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 67a4fa90e2183d009f14b0952284dab6 columnFamilyName f1 2023-02-12 06:02:59,256 INFO [StoreOpener-67a4fa90e2183d009f14b0952284dab6-1] regionserver.HStore(310): Store=67a4fa90e2183d009f14b0952284dab6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:59,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/7db93b0592a0ffbad72426a53dea531d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:02:59,256 INFO [StoreOpener-67a4fa90e2183d009f14b0952284dab6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 67a4fa90e2183d009f14b0952284dab6 2023-02-12 06:02:59,257 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7db93b0592a0ffbad72426a53dea531d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60546502, jitterRate=-0.0977868139743805}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:02:59,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7db93b0592a0ffbad72426a53dea531d: Running coprocessor pre-open hook at 1676181779244Writing region info on filesystem at 1676181779244Initializing all the Stores at 1676181779245 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181779245Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181779245Cleaning up temporary data from old regions at 1676181779251 (+6 ms)Cleaning up detritus from prior splits at 1676181779252 (+1 ms)Running coprocessor post-open hooks at 1676181779257 (+5 ms)Region opened successfully at 1676181779257 2023-02-12 06:02:59,258 DEBUG [StoreOpener-67a4fa90e2183d009f14b0952284dab6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/67a4fa90e2183d009f14b0952284dab6/f2 2023-02-12 06:02:59,258 DEBUG [StoreOpener-67a4fa90e2183d009f14b0952284dab6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/67a4fa90e2183d009f14b0952284dab6/f2 2023-02-12 06:02:59,258 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d., pid=21, masterSystemTime=1676181779239 2023-02-12 06:02:59,258 INFO [StoreOpener-67a4fa90e2183d009f14b0952284dab6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 67a4fa90e2183d009f14b0952284dab6 columnFamilyName f2 2023-02-12 06:02:59,259 INFO [StoreOpener-67a4fa90e2183d009f14b0952284dab6-1] regionserver.HStore(310): Store=67a4fa90e2183d009f14b0952284dab6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:59,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/67a4fa90e2183d009f14b0952284dab6 2023-02-12 06:02:59,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/67a4fa90e2183d009f14b0952284dab6 2023-02-12 06:02:59,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d. 2023-02-12 06:02:59,260 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d. 2023-02-12 06:02:59,260 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500. 2023-02-12 06:02:59,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 96e1fed3c51e76d3db58034d221e5500, NAME => 'testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-12 06:02:59,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 96e1fed3c51e76d3db58034d221e5500 2023-02-12 06:02:59,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:59,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 96e1fed3c51e76d3db58034d221e5500 2023-02-12 06:02:59,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 96e1fed3c51e76d3db58034d221e5500 2023-02-12 06:02:59,262 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=7db93b0592a0ffbad72426a53dea531d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:02:59,262 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181779262"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676181779262"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676181779262"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676181779262"}]},"ts":"1676181779262"} 2023-02-12 06:02:59,263 INFO [StoreOpener-96e1fed3c51e76d3db58034d221e5500-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 96e1fed3c51e76d3db58034d221e5500 2023-02-12 06:02:59,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:02:59,264 DEBUG [StoreOpener-96e1fed3c51e76d3db58034d221e5500-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/96e1fed3c51e76d3db58034d221e5500/f1 2023-02-12 06:02:59,264 DEBUG [StoreOpener-96e1fed3c51e76d3db58034d221e5500-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/96e1fed3c51e76d3db58034d221e5500/f1 2023-02-12 06:02:59,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 67a4fa90e2183d009f14b0952284dab6 2023-02-12 06:02:59,265 INFO [StoreOpener-96e1fed3c51e76d3db58034d221e5500-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 96e1fed3c51e76d3db58034d221e5500 columnFamilyName f1 2023-02-12 06:02:59,265 INFO [StoreOpener-96e1fed3c51e76d3db58034d221e5500-1] regionserver.HStore(310): Store=96e1fed3c51e76d3db58034d221e5500/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:59,265 INFO [StoreOpener-96e1fed3c51e76d3db58034d221e5500-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 96e1fed3c51e76d3db58034d221e5500 2023-02-12 06:02:59,266 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=16 2023-02-12 06:02:59,266 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=16, state=SUCCESS; OpenRegionProcedure 7db93b0592a0ffbad72426a53dea531d, server=jenkins-hbase4.apache.org,42183,1676181777167 in 177 msec 2023-02-12 06:02:59,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/67a4fa90e2183d009f14b0952284dab6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:02:59,268 DEBUG [StoreOpener-96e1fed3c51e76d3db58034d221e5500-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/96e1fed3c51e76d3db58034d221e5500/f2 2023-02-12 06:02:59,268 DEBUG [StoreOpener-96e1fed3c51e76d3db58034d221e5500-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/96e1fed3c51e76d3db58034d221e5500/f2 2023-02-12 06:02:59,268 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7db93b0592a0ffbad72426a53dea531d, ASSIGN in 340 msec 2023-02-12 06:02:59,268 INFO [StoreOpener-96e1fed3c51e76d3db58034d221e5500-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 96e1fed3c51e76d3db58034d221e5500 columnFamilyName f2 2023-02-12 06:02:59,268 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 67a4fa90e2183d009f14b0952284dab6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73362820, jitterRate=0.09319120645523071}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:02:59,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 67a4fa90e2183d009f14b0952284dab6: Running coprocessor pre-open hook at 1676181779253Writing region info on filesystem at 1676181779253Initializing all the Stores at 1676181779254 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181779254Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181779254Cleaning up temporary data from old regions at 1676181779262 (+8 ms)Cleaning up detritus from prior splits at 1676181779262Running coprocessor post-open hooks at 1676181779268 (+6 ms)Region opened successfully at 1676181779268 2023-02-12 06:02:59,269 INFO [StoreOpener-96e1fed3c51e76d3db58034d221e5500-1] regionserver.HStore(310): Store=96e1fed3c51e76d3db58034d221e5500/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:59,269 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6., pid=29, masterSystemTime=1676181779249 2023-02-12 06:02:59,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/96e1fed3c51e76d3db58034d221e5500 2023-02-12 06:02:59,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/96e1fed3c51e76d3db58034d221e5500 2023-02-12 06:02:59,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6. 2023-02-12 06:02:59,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6. 2023-02-12 06:02:59,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec. 2023-02-12 06:02:59,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ac4bbab435a2c040bbdb8338c993e6ec, NAME => 'testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-12 06:02:59,271 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=67a4fa90e2183d009f14b0952284dab6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:02:59,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce ac4bbab435a2c040bbdb8338c993e6ec 2023-02-12 06:02:59,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:59,271 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676181779271"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676181779271"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676181779271"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676181779271"}]},"ts":"1676181779271"} 2023-02-12 06:02:59,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ac4bbab435a2c040bbdb8338c993e6ec 2023-02-12 06:02:59,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ac4bbab435a2c040bbdb8338c993e6ec 2023-02-12 06:02:59,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:02:59,273 INFO [StoreOpener-ac4bbab435a2c040bbdb8338c993e6ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ac4bbab435a2c040bbdb8338c993e6ec 2023-02-12 06:02:59,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 96e1fed3c51e76d3db58034d221e5500 2023-02-12 06:02:59,275 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=11 2023-02-12 06:02:59,275 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=11, state=SUCCESS; OpenRegionProcedure 67a4fa90e2183d009f14b0952284dab6, server=jenkins-hbase4.apache.org,37181,1676181777204 in 173 msec 2023-02-12 06:02:59,275 DEBUG [StoreOpener-ac4bbab435a2c040bbdb8338c993e6ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/ac4bbab435a2c040bbdb8338c993e6ec/f1 2023-02-12 06:02:59,275 DEBUG [StoreOpener-ac4bbab435a2c040bbdb8338c993e6ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/ac4bbab435a2c040bbdb8338c993e6ec/f1 2023-02-12 06:02:59,276 INFO [StoreOpener-ac4bbab435a2c040bbdb8338c993e6ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ac4bbab435a2c040bbdb8338c993e6ec columnFamilyName f1 2023-02-12 06:02:59,276 INFO [StoreOpener-ac4bbab435a2c040bbdb8338c993e6ec-1] regionserver.HStore(310): Store=ac4bbab435a2c040bbdb8338c993e6ec/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:59,276 INFO [StoreOpener-ac4bbab435a2c040bbdb8338c993e6ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ac4bbab435a2c040bbdb8338c993e6ec 2023-02-12 06:02:59,276 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=67a4fa90e2183d009f14b0952284dab6, ASSIGN in 349 msec 2023-02-12 06:02:59,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/96e1fed3c51e76d3db58034d221e5500/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:02:59,277 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 96e1fed3c51e76d3db58034d221e5500; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67158572, jitterRate=7.407069206237793E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:02:59,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 96e1fed3c51e76d3db58034d221e5500: Running coprocessor pre-open hook at 1676181779261Writing region info on filesystem at 1676181779261Initializing all the Stores at 1676181779262 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181779262Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181779263 (+1 ms)Cleaning up temporary data from old regions at 1676181779271 (+8 ms)Cleaning up detritus from prior splits at 1676181779271Running coprocessor post-open hooks at 1676181779277 (+6 ms)Region opened successfully at 1676181779277 2023-02-12 06:02:59,278 DEBUG [StoreOpener-ac4bbab435a2c040bbdb8338c993e6ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/ac4bbab435a2c040bbdb8338c993e6ec/f2 2023-02-12 06:02:59,278 DEBUG [StoreOpener-ac4bbab435a2c040bbdb8338c993e6ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/ac4bbab435a2c040bbdb8338c993e6ec/f2 2023-02-12 06:02:59,278 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500., pid=25, masterSystemTime=1676181779239 2023-02-12 06:02:59,278 INFO [StoreOpener-ac4bbab435a2c040bbdb8338c993e6ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ac4bbab435a2c040bbdb8338c993e6ec columnFamilyName f2 2023-02-12 06:02:59,279 INFO [StoreOpener-ac4bbab435a2c040bbdb8338c993e6ec-1] regionserver.HStore(310): Store=ac4bbab435a2c040bbdb8338c993e6ec/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:59,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/ac4bbab435a2c040bbdb8338c993e6ec 2023-02-12 06:02:59,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500. 2023-02-12 06:02:59,280 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500. 2023-02-12 06:02:59,280 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2. 2023-02-12 06:02:59,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5196f1f5c7fff2336111d751c7d841e2, NAME => 'testWithMapReduce,g\xA7\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-12 06:02:59,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/ac4bbab435a2c040bbdb8338c993e6ec 2023-02-12 06:02:59,280 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=96e1fed3c51e76d3db58034d221e5500, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:02:59,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 5196f1f5c7fff2336111d751c7d841e2 2023-02-12 06:02:59,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:59,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5196f1f5c7fff2336111d751c7d841e2 2023-02-12 06:02:59,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5196f1f5c7fff2336111d751c7d841e2 2023-02-12 06:02:59,280 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181779280"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676181779280"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676181779280"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676181779280"}]},"ts":"1676181779280"} 2023-02-12 06:02:59,281 INFO [StoreOpener-5196f1f5c7fff2336111d751c7d841e2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5196f1f5c7fff2336111d751c7d841e2 2023-02-12 06:02:59,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:02:59,283 DEBUG [StoreOpener-5196f1f5c7fff2336111d751c7d841e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/5196f1f5c7fff2336111d751c7d841e2/f1 2023-02-12 06:02:59,283 DEBUG [StoreOpener-5196f1f5c7fff2336111d751c7d841e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/5196f1f5c7fff2336111d751c7d841e2/f1 2023-02-12 06:02:59,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ac4bbab435a2c040bbdb8338c993e6ec 2023-02-12 06:02:59,283 INFO [StoreOpener-5196f1f5c7fff2336111d751c7d841e2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5196f1f5c7fff2336111d751c7d841e2 columnFamilyName f1 2023-02-12 06:02:59,284 INFO [StoreOpener-5196f1f5c7fff2336111d751c7d841e2-1] regionserver.HStore(310): Store=5196f1f5c7fff2336111d751c7d841e2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:59,284 INFO [StoreOpener-5196f1f5c7fff2336111d751c7d841e2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5196f1f5c7fff2336111d751c7d841e2 2023-02-12 06:02:59,286 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=13 2023-02-12 06:02:59,287 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=13, state=SUCCESS; OpenRegionProcedure 96e1fed3c51e76d3db58034d221e5500, server=jenkins-hbase4.apache.org,42183,1676181777167 in 194 msec 2023-02-12 06:02:59,288 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=96e1fed3c51e76d3db58034d221e5500, ASSIGN in 361 msec 2023-02-12 06:02:59,289 DEBUG [StoreOpener-5196f1f5c7fff2336111d751c7d841e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/5196f1f5c7fff2336111d751c7d841e2/f2 2023-02-12 06:02:59,289 DEBUG [StoreOpener-5196f1f5c7fff2336111d751c7d841e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/5196f1f5c7fff2336111d751c7d841e2/f2 2023-02-12 06:02:59,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/ac4bbab435a2c040bbdb8338c993e6ec/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:02:59,289 INFO [StoreOpener-5196f1f5c7fff2336111d751c7d841e2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5196f1f5c7fff2336111d751c7d841e2 columnFamilyName f2 2023-02-12 06:02:59,290 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ac4bbab435a2c040bbdb8338c993e6ec; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60235537, jitterRate=-0.10242055356502533}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:02:59,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ac4bbab435a2c040bbdb8338c993e6ec: Running coprocessor pre-open hook at 1676181779271Writing region info on filesystem at 1676181779271Initializing all the Stores at 1676181779272 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181779273 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181779273Cleaning up temporary data from old regions at 1676181779281 (+8 ms)Cleaning up detritus from prior splits at 1676181779281Running coprocessor post-open hooks at 1676181779290 (+9 ms)Region opened successfully at 1676181779290 2023-02-12 06:02:59,290 INFO [StoreOpener-5196f1f5c7fff2336111d751c7d841e2-1] regionserver.HStore(310): Store=5196f1f5c7fff2336111d751c7d841e2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:59,291 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec., pid=26, masterSystemTime=1676181779249 2023-02-12 06:02:59,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/5196f1f5c7fff2336111d751c7d841e2 2023-02-12 06:02:59,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/5196f1f5c7fff2336111d751c7d841e2 2023-02-12 06:02:59,293 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec. 2023-02-12 06:02:59,293 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec. 2023-02-12 06:02:59,293 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2. 2023-02-12 06:02:59,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1d974d28b432221ca9ffde441bf98fb2, NAME => 'testWithMapReduce,j\xCA\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-12 06:02:59,294 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=ac4bbab435a2c040bbdb8338c993e6ec, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:02:59,294 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181779293"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676181779293"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676181779293"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676181779293"}]},"ts":"1676181779293"} 2023-02-12 06:02:59,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 1d974d28b432221ca9ffde441bf98fb2 2023-02-12 06:02:59,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:02:59,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:59,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1d974d28b432221ca9ffde441bf98fb2 2023-02-12 06:02:59,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1d974d28b432221ca9ffde441bf98fb2 2023-02-12 06:02:59,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5196f1f5c7fff2336111d751c7d841e2 2023-02-12 06:02:59,297 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=19 2023-02-12 06:02:59,298 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=19, state=SUCCESS; OpenRegionProcedure ac4bbab435a2c040bbdb8338c993e6ec, server=jenkins-hbase4.apache.org,37181,1676181777204 in 201 msec 2023-02-12 06:02:59,299 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ac4bbab435a2c040bbdb8338c993e6ec, ASSIGN in 372 msec 2023-02-12 06:02:59,300 INFO [StoreOpener-1d974d28b432221ca9ffde441bf98fb2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1d974d28b432221ca9ffde441bf98fb2 2023-02-12 06:02:59,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/5196f1f5c7fff2336111d751c7d841e2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:02:59,305 DEBUG [StoreOpener-1d974d28b432221ca9ffde441bf98fb2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/1d974d28b432221ca9ffde441bf98fb2/f1 2023-02-12 06:02:59,305 DEBUG [StoreOpener-1d974d28b432221ca9ffde441bf98fb2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/1d974d28b432221ca9ffde441bf98fb2/f1 2023-02-12 06:02:59,305 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5196f1f5c7fff2336111d751c7d841e2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68661543, jitterRate=0.023136720061302185}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:02:59,305 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5196f1f5c7fff2336111d751c7d841e2: Running coprocessor pre-open hook at 1676181779280Writing region info on filesystem at 1676181779280Initializing all the Stores at 1676181779281 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181779281Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181779281Cleaning up temporary data from old regions at 1676181779292 (+11 ms)Cleaning up detritus from prior splits at 1676181779293 (+1 ms)Running coprocessor post-open hooks at 1676181779305 (+12 ms)Region opened successfully at 1676181779305 2023-02-12 06:02:59,305 INFO [StoreOpener-1d974d28b432221ca9ffde441bf98fb2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1d974d28b432221ca9ffde441bf98fb2 columnFamilyName f1 2023-02-12 06:02:59,306 INFO [StoreOpener-1d974d28b432221ca9ffde441bf98fb2-1] regionserver.HStore(310): Store=1d974d28b432221ca9ffde441bf98fb2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:59,306 INFO [StoreOpener-1d974d28b432221ca9ffde441bf98fb2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1d974d28b432221ca9ffde441bf98fb2 2023-02-12 06:02:59,307 DEBUG [StoreOpener-1d974d28b432221ca9ffde441bf98fb2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/1d974d28b432221ca9ffde441bf98fb2/f2 2023-02-12 06:02:59,307 DEBUG [StoreOpener-1d974d28b432221ca9ffde441bf98fb2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/1d974d28b432221ca9ffde441bf98fb2/f2 2023-02-12 06:02:59,307 INFO [StoreOpener-1d974d28b432221ca9ffde441bf98fb2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1d974d28b432221ca9ffde441bf98fb2 columnFamilyName f2 2023-02-12 06:02:59,308 INFO [StoreOpener-1d974d28b432221ca9ffde441bf98fb2-1] regionserver.HStore(310): Store=1d974d28b432221ca9ffde441bf98fb2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:59,309 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2., pid=24, masterSystemTime=1676181779239 2023-02-12 06:02:59,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/1d974d28b432221ca9ffde441bf98fb2 2023-02-12 06:02:59,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/1d974d28b432221ca9ffde441bf98fb2 2023-02-12 06:02:59,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2. 2023-02-12 06:02:59,310 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2. 2023-02-12 06:02:59,311 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3. 2023-02-12 06:02:59,311 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=5196f1f5c7fff2336111d751c7d841e2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:02:59,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0791c9d76ddc855936e4dac63b936fe3, NAME => 'testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-12 06:02:59,311 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181779311"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676181779311"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676181779311"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676181779311"}]},"ts":"1676181779311"} 2023-02-12 06:02:59,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 0791c9d76ddc855936e4dac63b936fe3 2023-02-12 06:02:59,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:59,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0791c9d76ddc855936e4dac63b936fe3 2023-02-12 06:02:59,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0791c9d76ddc855936e4dac63b936fe3 2023-02-12 06:02:59,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:02:59,313 INFO [StoreOpener-0791c9d76ddc855936e4dac63b936fe3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0791c9d76ddc855936e4dac63b936fe3 2023-02-12 06:02:59,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1d974d28b432221ca9ffde441bf98fb2 2023-02-12 06:02:59,314 DEBUG [StoreOpener-0791c9d76ddc855936e4dac63b936fe3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/0791c9d76ddc855936e4dac63b936fe3/f1 2023-02-12 06:02:59,315 DEBUG [StoreOpener-0791c9d76ddc855936e4dac63b936fe3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/0791c9d76ddc855936e4dac63b936fe3/f1 2023-02-12 06:02:59,315 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=14 2023-02-12 06:02:59,315 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=14, state=SUCCESS; OpenRegionProcedure 5196f1f5c7fff2336111d751c7d841e2, server=jenkins-hbase4.apache.org,42183,1676181777167 in 223 msec 2023-02-12 06:02:59,315 INFO [StoreOpener-0791c9d76ddc855936e4dac63b936fe3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0791c9d76ddc855936e4dac63b936fe3 columnFamilyName f1 2023-02-12 06:02:59,315 INFO [StoreOpener-0791c9d76ddc855936e4dac63b936fe3-1] regionserver.HStore(310): Store=0791c9d76ddc855936e4dac63b936fe3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:59,316 INFO [StoreOpener-0791c9d76ddc855936e4dac63b936fe3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0791c9d76ddc855936e4dac63b936fe3 2023-02-12 06:02:59,317 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5196f1f5c7fff2336111d751c7d841e2, ASSIGN in 389 msec 2023-02-12 06:02:59,317 DEBUG [StoreOpener-0791c9d76ddc855936e4dac63b936fe3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/0791c9d76ddc855936e4dac63b936fe3/f2 2023-02-12 06:02:59,317 DEBUG [StoreOpener-0791c9d76ddc855936e4dac63b936fe3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/0791c9d76ddc855936e4dac63b936fe3/f2 2023-02-12 06:02:59,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/1d974d28b432221ca9ffde441bf98fb2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:02:59,317 INFO [StoreOpener-0791c9d76ddc855936e4dac63b936fe3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0791c9d76ddc855936e4dac63b936fe3 columnFamilyName f2 2023-02-12 06:02:59,318 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1d974d28b432221ca9ffde441bf98fb2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72903806, jitterRate=0.08635136485099792}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:02:59,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1d974d28b432221ca9ffde441bf98fb2: Running coprocessor pre-open hook at 1676181779295Writing region info on filesystem at 1676181779295Initializing all the Stores at 1676181779296 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181779296Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181779300 (+4 ms)Cleaning up temporary data from old regions at 1676181779311 (+11 ms)Cleaning up detritus from prior splits at 1676181779311Running coprocessor post-open hooks at 1676181779318 (+7 ms)Region opened successfully at 1676181779318 2023-02-12 06:02:59,318 INFO [StoreOpener-0791c9d76ddc855936e4dac63b936fe3-1] regionserver.HStore(310): Store=0791c9d76ddc855936e4dac63b936fe3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:59,318 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2., pid=27, masterSystemTime=1676181779249 2023-02-12 06:02:59,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/0791c9d76ddc855936e4dac63b936fe3 2023-02-12 06:02:59,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/0791c9d76ddc855936e4dac63b936fe3 2023-02-12 06:02:59,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2. 2023-02-12 06:02:59,320 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2. 2023-02-12 06:02:59,320 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a. 2023-02-12 06:02:59,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c208c138f9bebfcad824fa3fbb7e912a, NAME => 'testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-12 06:02:59,321 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=1d974d28b432221ca9ffde441bf98fb2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:02:59,321 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181779320"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676181779320"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676181779320"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676181779320"}]},"ts":"1676181779320"} 2023-02-12 06:02:59,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce c208c138f9bebfcad824fa3fbb7e912a 2023-02-12 06:02:59,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:59,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c208c138f9bebfcad824fa3fbb7e912a 2023-02-12 06:02:59,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c208c138f9bebfcad824fa3fbb7e912a 2023-02-12 06:02:59,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:02:59,323 INFO [StoreOpener-c208c138f9bebfcad824fa3fbb7e912a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c208c138f9bebfcad824fa3fbb7e912a 2023-02-12 06:02:59,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0791c9d76ddc855936e4dac63b936fe3 2023-02-12 06:02:59,324 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=15 2023-02-12 06:02:59,325 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=15, state=SUCCESS; OpenRegionProcedure 1d974d28b432221ca9ffde441bf98fb2, server=jenkins-hbase4.apache.org,37181,1676181777204 in 225 msec 2023-02-12 06:02:59,325 DEBUG [StoreOpener-c208c138f9bebfcad824fa3fbb7e912a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/c208c138f9bebfcad824fa3fbb7e912a/f1 2023-02-12 06:02:59,325 DEBUG [StoreOpener-c208c138f9bebfcad824fa3fbb7e912a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/c208c138f9bebfcad824fa3fbb7e912a/f1 2023-02-12 06:02:59,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/0791c9d76ddc855936e4dac63b936fe3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:02:59,326 INFO [StoreOpener-c208c138f9bebfcad824fa3fbb7e912a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c208c138f9bebfcad824fa3fbb7e912a columnFamilyName f1 2023-02-12 06:02:59,326 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=1d974d28b432221ca9ffde441bf98fb2, ASSIGN in 399 msec 2023-02-12 06:02:59,326 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0791c9d76ddc855936e4dac63b936fe3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70331288, jitterRate=0.04801785945892334}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:02:59,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0791c9d76ddc855936e4dac63b936fe3: Running coprocessor pre-open hook at 1676181779311Writing region info on filesystem at 1676181779311Initializing all the Stores at 1676181779312 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181779312Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181779313 (+1 ms)Cleaning up temporary data from old regions at 1676181779320 (+7 ms)Cleaning up detritus from prior splits at 1676181779321 (+1 ms)Running coprocessor post-open hooks at 1676181779326 (+5 ms)Region opened successfully at 1676181779326 2023-02-12 06:02:59,327 INFO [StoreOpener-c208c138f9bebfcad824fa3fbb7e912a-1] regionserver.HStore(310): Store=c208c138f9bebfcad824fa3fbb7e912a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:59,327 INFO [StoreOpener-c208c138f9bebfcad824fa3fbb7e912a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c208c138f9bebfcad824fa3fbb7e912a 2023-02-12 06:02:59,327 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3., pid=22, masterSystemTime=1676181779239 2023-02-12 06:02:59,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3. 2023-02-12 06:02:59,329 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3. 2023-02-12 06:02:59,329 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507. 2023-02-12 06:02:59,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ec61a0ee1596767b26f9746acbc2e507, NAME => 'testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-12 06:02:59,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce ec61a0ee1596767b26f9746acbc2e507 2023-02-12 06:02:59,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:59,329 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=0791c9d76ddc855936e4dac63b936fe3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:02:59,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ec61a0ee1596767b26f9746acbc2e507 2023-02-12 06:02:59,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ec61a0ee1596767b26f9746acbc2e507 2023-02-12 06:02:59,330 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181779329"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676181779329"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676181779329"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676181779329"}]},"ts":"1676181779329"} 2023-02-12 06:02:59,331 DEBUG [StoreOpener-c208c138f9bebfcad824fa3fbb7e912a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/c208c138f9bebfcad824fa3fbb7e912a/f2 2023-02-12 06:02:59,331 DEBUG [StoreOpener-c208c138f9bebfcad824fa3fbb7e912a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/c208c138f9bebfcad824fa3fbb7e912a/f2 2023-02-12 06:02:59,331 INFO [StoreOpener-c208c138f9bebfcad824fa3fbb7e912a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c208c138f9bebfcad824fa3fbb7e912a columnFamilyName f2 2023-02-12 06:02:59,331 INFO [StoreOpener-ec61a0ee1596767b26f9746acbc2e507-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ec61a0ee1596767b26f9746acbc2e507 2023-02-12 06:02:59,332 INFO [StoreOpener-c208c138f9bebfcad824fa3fbb7e912a-1] regionserver.HStore(310): Store=c208c138f9bebfcad824fa3fbb7e912a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:59,333 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=18 2023-02-12 06:02:59,333 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=18, state=SUCCESS; OpenRegionProcedure 0791c9d76ddc855936e4dac63b936fe3, server=jenkins-hbase4.apache.org,42183,1676181777167 in 243 msec 2023-02-12 06:02:59,333 DEBUG [StoreOpener-ec61a0ee1596767b26f9746acbc2e507-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/ec61a0ee1596767b26f9746acbc2e507/f1 2023-02-12 06:02:59,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/c208c138f9bebfcad824fa3fbb7e912a 2023-02-12 06:02:59,334 DEBUG [StoreOpener-ec61a0ee1596767b26f9746acbc2e507-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/ec61a0ee1596767b26f9746acbc2e507/f1 2023-02-12 06:02:59,334 INFO [StoreOpener-ec61a0ee1596767b26f9746acbc2e507-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec61a0ee1596767b26f9746acbc2e507 columnFamilyName f1 2023-02-12 06:02:59,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/c208c138f9bebfcad824fa3fbb7e912a 2023-02-12 06:02:59,335 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0791c9d76ddc855936e4dac63b936fe3, ASSIGN in 407 msec 2023-02-12 06:02:59,335 INFO [StoreOpener-ec61a0ee1596767b26f9746acbc2e507-1] regionserver.HStore(310): Store=ec61a0ee1596767b26f9746acbc2e507/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:59,335 INFO [StoreOpener-ec61a0ee1596767b26f9746acbc2e507-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ec61a0ee1596767b26f9746acbc2e507 2023-02-12 06:02:59,337 DEBUG [StoreOpener-ec61a0ee1596767b26f9746acbc2e507-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/ec61a0ee1596767b26f9746acbc2e507/f2 2023-02-12 06:02:59,337 DEBUG [StoreOpener-ec61a0ee1596767b26f9746acbc2e507-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/ec61a0ee1596767b26f9746acbc2e507/f2 2023-02-12 06:02:59,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:02:59,337 INFO [StoreOpener-ec61a0ee1596767b26f9746acbc2e507-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec61a0ee1596767b26f9746acbc2e507 columnFamilyName f2 2023-02-12 06:02:59,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c208c138f9bebfcad824fa3fbb7e912a 2023-02-12 06:02:59,340 INFO [StoreOpener-ec61a0ee1596767b26f9746acbc2e507-1] regionserver.HStore(310): Store=ec61a0ee1596767b26f9746acbc2e507/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:59,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/c208c138f9bebfcad824fa3fbb7e912a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:02:59,341 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c208c138f9bebfcad824fa3fbb7e912a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60415976, jitterRate=-0.09973180294036865}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:02:59,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/ec61a0ee1596767b26f9746acbc2e507 2023-02-12 06:02:59,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c208c138f9bebfcad824fa3fbb7e912a: Running coprocessor pre-open hook at 1676181779321Writing region info on filesystem at 1676181779321Initializing all the Stores at 1676181779322 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181779322Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181779322Cleaning up temporary data from old regions at 1676181779335 (+13 ms)Cleaning up detritus from prior splits at 1676181779336 (+1 ms)Running coprocessor post-open hooks at 1676181779341 (+5 ms)Region opened successfully at 1676181779341 2023-02-12 06:02:59,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/ec61a0ee1596767b26f9746acbc2e507 2023-02-12 06:02:59,342 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a., pid=28, masterSystemTime=1676181779249 2023-02-12 06:02:59,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:02:59,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a. 2023-02-12 06:02:59,344 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a. 2023-02-12 06:02:59,344 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b. 2023-02-12 06:02:59,344 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=c208c138f9bebfcad824fa3fbb7e912a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:02:59,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => bc33ffcdfaec411e24236b6d44e5db2b, NAME => 'testWithMapReduce,q\x11\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-12 06:02:59,345 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181779344"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676181779344"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676181779344"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676181779344"}]},"ts":"1676181779344"} 2023-02-12 06:02:59,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce bc33ffcdfaec411e24236b6d44e5db2b 2023-02-12 06:02:59,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:02:59,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for bc33ffcdfaec411e24236b6d44e5db2b 2023-02-12 06:02:59,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for bc33ffcdfaec411e24236b6d44e5db2b 2023-02-12 06:02:59,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ec61a0ee1596767b26f9746acbc2e507 2023-02-12 06:02:59,347 INFO [StoreOpener-bc33ffcdfaec411e24236b6d44e5db2b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bc33ffcdfaec411e24236b6d44e5db2b 2023-02-12 06:02:59,349 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=12 2023-02-12 06:02:59,349 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=12, state=SUCCESS; OpenRegionProcedure c208c138f9bebfcad824fa3fbb7e912a, server=jenkins-hbase4.apache.org,37181,1676181777204 in 249 msec 2023-02-12 06:02:59,349 DEBUG [StoreOpener-bc33ffcdfaec411e24236b6d44e5db2b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/bc33ffcdfaec411e24236b6d44e5db2b/f1 2023-02-12 06:02:59,349 DEBUG [StoreOpener-bc33ffcdfaec411e24236b6d44e5db2b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/bc33ffcdfaec411e24236b6d44e5db2b/f1 2023-02-12 06:02:59,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/ec61a0ee1596767b26f9746acbc2e507/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:02:59,350 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ec61a0ee1596767b26f9746acbc2e507; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73720906, jitterRate=0.09852710366249084}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:02:59,350 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=c208c138f9bebfcad824fa3fbb7e912a, ASSIGN in 423 msec 2023-02-12 06:02:59,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ec61a0ee1596767b26f9746acbc2e507: Running coprocessor pre-open hook at 1676181779330Writing region info on filesystem at 1676181779330Initializing all the Stores at 1676181779331 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181779331Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181779331Cleaning up temporary data from old regions at 1676181779342 (+11 ms)Cleaning up detritus from prior splits at 1676181779343 (+1 ms)Running coprocessor post-open hooks at 1676181779350 (+7 ms)Region opened successfully at 1676181779350 2023-02-12 06:02:59,350 INFO [StoreOpener-bc33ffcdfaec411e24236b6d44e5db2b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bc33ffcdfaec411e24236b6d44e5db2b columnFamilyName f1 2023-02-12 06:02:59,351 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507., pid=23, masterSystemTime=1676181779239 2023-02-12 06:02:59,352 INFO [StoreOpener-bc33ffcdfaec411e24236b6d44e5db2b-1] regionserver.HStore(310): Store=bc33ffcdfaec411e24236b6d44e5db2b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:59,352 INFO [StoreOpener-bc33ffcdfaec411e24236b6d44e5db2b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bc33ffcdfaec411e24236b6d44e5db2b 2023-02-12 06:02:59,353 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=ec61a0ee1596767b26f9746acbc2e507, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:02:59,353 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676181779353"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676181779353"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676181779353"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676181779353"}]},"ts":"1676181779353"} 2023-02-12 06:02:59,354 DEBUG [StoreOpener-bc33ffcdfaec411e24236b6d44e5db2b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/bc33ffcdfaec411e24236b6d44e5db2b/f2 2023-02-12 06:02:59,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507. 2023-02-12 06:02:59,354 DEBUG [StoreOpener-bc33ffcdfaec411e24236b6d44e5db2b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/bc33ffcdfaec411e24236b6d44e5db2b/f2 2023-02-12 06:02:59,354 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507. 2023-02-12 06:02:59,355 INFO [StoreOpener-bc33ffcdfaec411e24236b6d44e5db2b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bc33ffcdfaec411e24236b6d44e5db2b columnFamilyName f2 2023-02-12 06:02:59,356 INFO [StoreOpener-bc33ffcdfaec411e24236b6d44e5db2b-1] regionserver.HStore(310): Store=bc33ffcdfaec411e24236b6d44e5db2b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:02:59,357 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=20 2023-02-12 06:02:59,357 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=20, state=SUCCESS; OpenRegionProcedure ec61a0ee1596767b26f9746acbc2e507, server=jenkins-hbase4.apache.org,42183,1676181777167 in 266 msec 2023-02-12 06:02:59,358 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ec61a0ee1596767b26f9746acbc2e507, ASSIGN in 431 msec 2023-02-12 06:02:59,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/bc33ffcdfaec411e24236b6d44e5db2b 2023-02-12 06:02:59,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/bc33ffcdfaec411e24236b6d44e5db2b 2023-02-12 06:02:59,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:02:59,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for bc33ffcdfaec411e24236b6d44e5db2b 2023-02-12 06:02:59,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/bc33ffcdfaec411e24236b6d44e5db2b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:02:59,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened bc33ffcdfaec411e24236b6d44e5db2b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69948091, jitterRate=0.0423077791929245}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:02:59,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for bc33ffcdfaec411e24236b6d44e5db2b: Running coprocessor pre-open hook at 1676181779345Writing region info on filesystem at 1676181779345Initializing all the Stores at 1676181779346 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181779346Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181779347 (+1 ms)Cleaning up temporary data from old regions at 1676181779360 (+13 ms)Cleaning up detritus from prior splits at 1676181779360Running coprocessor post-open hooks at 1676181779365 (+5 ms)Region opened successfully at 1676181779365 2023-02-12 06:02:59,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b., pid=30, masterSystemTime=1676181779249 2023-02-12 06:02:59,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b. 2023-02-12 06:02:59,367 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b. 2023-02-12 06:02:59,367 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=bc33ffcdfaec411e24236b6d44e5db2b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:02:59,368 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676181779367"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676181779367"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676181779367"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676181779367"}]},"ts":"1676181779367"} 2023-02-12 06:02:59,371 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=17 2023-02-12 06:02:59,371 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=17, state=SUCCESS; OpenRegionProcedure bc33ffcdfaec411e24236b6d44e5db2b, server=jenkins-hbase4.apache.org,37181,1676181777204 in 268 msec 2023-02-12 06:02:59,374 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=10 2023-02-12 06:02:59,375 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=bc33ffcdfaec411e24236b6d44e5db2b, ASSIGN in 445 msec 2023-02-12 06:02:59,375 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 06:02:59,376 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676181779375"}]},"ts":"1676181779375"} 2023-02-12 06:02:59,377 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-12 06:02:59,380 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 06:02:59,381 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 931 msec 2023-02-12 06:02:59,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45631] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 06:02:59,561 INFO [Listener at localhost/40063] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-12 06:02:59,561 DEBUG [Listener at localhost/40063] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-12 06:02:59,561 INFO [Listener at localhost/40063] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 06:02:59,565 INFO [Listener at localhost/40063] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-12 06:02:59,565 INFO [Listener at localhost/40063] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 06:02:59,565 INFO [Listener at localhost/40063] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-12 06:02:59,565 INFO [Listener at localhost/40063] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-12 06:02:59,620 DEBUG [hconnection-0x3bcfe385-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 06:02:59,642 INFO [RS-EventLoopGroup-7-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37390, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 06:02:59,650 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42183] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500. 2023-02-12 06:02:59,655 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37181] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a. 2023-02-12 06:02:59,801 INFO [Listener at localhost/40063] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-12 06:02:59,802 INFO [Listener at localhost/40063] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-12 06:02:59,803 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45631] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 06:02:59,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45631] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676181779803 (current time:1676181779803). 2023-02-12 06:02:59,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45631] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-12 06:02:59,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45631] zookeeper.ReadOnlyZKClient(139): Connect 0x449671f3 to 127.0.0.1:61935 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 06:02:59,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45631] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f7b711b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 06:02:59,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45631] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 06:02:59,812 INFO [RS-EventLoopGroup-8-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43818, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 06:02:59,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45631] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x449671f3 to 127.0.0.1:61935 2023-02-12 06:02:59,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45631] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:02:59,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45631] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-12 06:02:59,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45631] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 06:02:59,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45631] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 06:02:59,817 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 06:02:59,818 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676182379818 2023-02-12 06:02:59,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45631] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 06:02:59,819 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-12 06:02:59,819 DEBUG [Listener at localhost/40063] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-12 06:02:59,820 DEBUG [Listener at localhost/40063] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-12 06:02:59,820 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 06:02:59,821 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 06:02:59,821 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 4 msec 2023-02-12 06:02:59,822 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 06:02:59,823 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676182379823 2023-02-12 06:02:59,840 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:02:59,844 INFO [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-12 06:02:59,844 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 06:02:59,845 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-12 06:02:59,845 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-12 06:02:59,845 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:02:59,845 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:02:59,847 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): regionserver:37181-0x1004720144c0002, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 06:02:59,847 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): regionserver:42183-0x1004720144c0001, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 06:02:59,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 06:02:59,847 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:02:59,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:02:59,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 06:02:59,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:02:59,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:02:59,847 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:02:59,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:02:59,847 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:02:59,848 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37181-0x1004720144c0002, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:02:59,848 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42183-0x1004720144c0001, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:02:59,848 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:02:59,848 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 06:02:59,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-12 06:02:59,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:02:59,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-12 06:02:59,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:02:59,848 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-12 06:02:59,848 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-12 06:02:59,849 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:02:59,849 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:02:59,849 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-12 06:02:59,849 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 06:02:59,853 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-12 06:02:59,853 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-12 06:02:59,853 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-12 06:02:59,853 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 06:02:59,853 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37181,1676181777204' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-12 06:02:59,853 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-12 06:02:59,853 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-12 06:02:59,853 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42183,1676181777167' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-12 06:02:59,855 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:02:59,855 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:02:59,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:02:59,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:02:59,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 06:02:59,856 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:02:59,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:02:59,856 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42183-0x1004720144c0001, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:02:59,856 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 06:02:59,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:02:59,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:02:59,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:02:59,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:02:59,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:02:59,858 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42183,1676181777167' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-12 06:02:59,858 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@685fec99[Count = 1] remaining members to acquire global barrier 2023-02-12 06:02:59,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:02:59,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:02:59,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 06:02:59,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:02:59,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:02:59,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:02:59,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:02:59,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:02:59,860 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:02:59,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:02:59,860 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37181-0x1004720144c0002, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:02:59,860 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 06:02:59,860 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37181,1676181777204' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-12 06:02:59,860 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@685fec99[Count = 0] remaining members to acquire global barrier 2023-02-12 06:02:59,860 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-12 06:02:59,861 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:02:59,863 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): regionserver:37181-0x1004720144c0002, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:02:59,863 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): regionserver:42183-0x1004720144c0001, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:02:59,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:02:59,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:02:59,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:02:59,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:02:59,863 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-12 06:02:59,863 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-12 06:02:59,863 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:02:59,864 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:02:59,864 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 06:02:59,868 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6. 2023-02-12 06:02:59,868 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6. started... 2023-02-12 06:02:59,873 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 67a4fa90e2183d009f14b0952284dab6: 2023-02-12 06:02:59,873 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a. 2023-02-12 06:02:59,873 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a. started... 2023-02-12 06:02:59,873 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-12 06:02:59,873 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2. 2023-02-12 06:02:59,874 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500. 2023-02-12 06:02:59,874 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-12 06:02:59,874 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3. 2023-02-12 06:02:59,873 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-1] regionserver.HRegion(2744): Flushing c208c138f9bebfcad824fa3fbb7e912a 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-12 06:02:59,873 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d. 2023-02-12 06:02:59,873 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:02:59,874 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 06:02:59,874 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 06:02:59,874 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 06:02:59,874 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d. started... 2023-02-12 06:02:59,874 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3. started... 2023-02-12 06:02:59,874 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 06:02:59,882 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 0791c9d76ddc855936e4dac63b936fe3 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 06:02:59,874 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500. started... 2023-02-12 06:02:59,874 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2. started... 2023-02-12 06:02:59,885 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 96e1fed3c51e76d3db58034d221e5500 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 06:02:59,874 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 06:02:59,881 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 7db93b0592a0ffbad72426a53dea531d 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 06:02:59,885 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 1d974d28b432221ca9ffde441bf98fb2 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 06:02:59,925 DEBUG [Listener at localhost/40063] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 06:02:59,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45631] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 06:02:59,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45631] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 06:02:59,928 DEBUG [Listener at localhost/40063] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-12 06:02:59,949 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6. completed. 2023-02-12 06:02:59,949 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6. 2023-02-12 06:02:59,949 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec. 2023-02-12 06:02:59,949 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec. started... 2023-02-12 06:02:59,949 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-12 06:02:59,952 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-0] regionserver.HRegion(2744): Flushing ac4bbab435a2c040bbdb8338c993e6ec 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-12 06:02:59,952 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/c208c138f9bebfcad824fa3fbb7e912a/.tmp/f1/7e64eaebcd674fe6a6482b512c81ff9b 2023-02-12 06:02:59,956 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/7db93b0592a0ffbad72426a53dea531d/.tmp/f1/a60b356808d34ee29a4eee52fc9fe1ac 2023-02-12 06:02:59,957 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/0791c9d76ddc855936e4dac63b936fe3/.tmp/f1/9432de1e6014498e8e57d4785475ce5a 2023-02-12 06:02:59,964 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/96e1fed3c51e76d3db58034d221e5500/.tmp/f1/78e3aebfcce24e00843083da6afff755 2023-02-12 06:02:59,966 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-12 06:02:59,994 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/ac4bbab435a2c040bbdb8338c993e6ec/.tmp/f1/346c1005cc48497287a044bcb69147a2 2023-02-12 06:03:00,039 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/0791c9d76ddc855936e4dac63b936fe3/.tmp/f2/022a27c10d2c4b8097d36881aa483136 2023-02-12 06:03:00,051 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/c208c138f9bebfcad824fa3fbb7e912a/.tmp/f2/da6af60022d94b43a637ec3d4977845c 2023-02-12 06:03:00,055 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/0791c9d76ddc855936e4dac63b936fe3/.tmp/f1/9432de1e6014498e8e57d4785475ce5a as hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/0791c9d76ddc855936e4dac63b936fe3/f1/9432de1e6014498e8e57d4785475ce5a 2023-02-12 06:03:00,062 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/96e1fed3c51e76d3db58034d221e5500/.tmp/f2/c353a1a1500f4a819596bb5a29beca05 2023-02-12 06:03:00,070 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/0791c9d76ddc855936e4dac63b936fe3/f1/9432de1e6014498e8e57d4785475ce5a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 06:03:00,070 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/ac4bbab435a2c040bbdb8338c993e6ec/.tmp/f2/9490c477867c4eea8a2f126fe40ee0a9 2023-02-12 06:03:00,071 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/0791c9d76ddc855936e4dac63b936fe3/.tmp/f2/022a27c10d2c4b8097d36881aa483136 as hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/0791c9d76ddc855936e4dac63b936fe3/f2/022a27c10d2c4b8097d36881aa483136 2023-02-12 06:03:00,072 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/7db93b0592a0ffbad72426a53dea531d/.tmp/f2/054dfcfd9556487eb625b71080808f88 2023-02-12 06:03:00,073 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/c208c138f9bebfcad824fa3fbb7e912a/.tmp/f1/7e64eaebcd674fe6a6482b512c81ff9b as hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/c208c138f9bebfcad824fa3fbb7e912a/f1/7e64eaebcd674fe6a6482b512c81ff9b 2023-02-12 06:03:00,082 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/ac4bbab435a2c040bbdb8338c993e6ec/.tmp/f1/346c1005cc48497287a044bcb69147a2 as hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/ac4bbab435a2c040bbdb8338c993e6ec/f1/346c1005cc48497287a044bcb69147a2 2023-02-12 06:03:00,083 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/96e1fed3c51e76d3db58034d221e5500/.tmp/f1/78e3aebfcce24e00843083da6afff755 as hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/96e1fed3c51e76d3db58034d221e5500/f1/78e3aebfcce24e00843083da6afff755 2023-02-12 06:03:00,084 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/c208c138f9bebfcad824fa3fbb7e912a/f1/7e64eaebcd674fe6a6482b512c81ff9b, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 06:03:00,086 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/7db93b0592a0ffbad72426a53dea531d/.tmp/f1/a60b356808d34ee29a4eee52fc9fe1ac as hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/7db93b0592a0ffbad72426a53dea531d/f1/a60b356808d34ee29a4eee52fc9fe1ac 2023-02-12 06:03:00,086 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/c208c138f9bebfcad824fa3fbb7e912a/.tmp/f2/da6af60022d94b43a637ec3d4977845c as hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/c208c138f9bebfcad824fa3fbb7e912a/f2/da6af60022d94b43a637ec3d4977845c 2023-02-12 06:03:00,096 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/ac4bbab435a2c040bbdb8338c993e6ec/f1/346c1005cc48497287a044bcb69147a2, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 06:03:00,097 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/0791c9d76ddc855936e4dac63b936fe3/f2/022a27c10d2c4b8097d36881aa483136, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 06:03:00,098 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/ac4bbab435a2c040bbdb8338c993e6ec/.tmp/f2/9490c477867c4eea8a2f126fe40ee0a9 as hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/ac4bbab435a2c040bbdb8338c993e6ec/f2/9490c477867c4eea8a2f126fe40ee0a9 2023-02-12 06:03:00,098 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 0791c9d76ddc855936e4dac63b936fe3 in 216ms, sequenceid=5, compaction requested=false 2023-02-12 06:03:00,098 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/7db93b0592a0ffbad72426a53dea531d/f1/a60b356808d34ee29a4eee52fc9fe1ac, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 06:03:00,098 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-12 06:03:00,099 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/c208c138f9bebfcad824fa3fbb7e912a/f2/da6af60022d94b43a637ec3d4977845c, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 06:03:00,099 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 0791c9d76ddc855936e4dac63b936fe3: 2023-02-12 06:03:00,100 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/7db93b0592a0ffbad72426a53dea531d/.tmp/f2/054dfcfd9556487eb625b71080808f88 as hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/7db93b0592a0ffbad72426a53dea531d/f2/054dfcfd9556487eb625b71080808f88 2023-02-12 06:03:00,100 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,100 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 06:03:00,100 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/0791c9d76ddc855936e4dac63b936fe3/f1/9432de1e6014498e8e57d4785475ce5a] hfiles 2023-02-12 06:03:00,101 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/0791c9d76ddc855936e4dac63b936fe3/f1/9432de1e6014498e8e57d4785475ce5a for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,101 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/0791c9d76ddc855936e4dac63b936fe3/f2/022a27c10d2c4b8097d36881aa483136] hfiles 2023-02-12 06:03:00,101 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/0791c9d76ddc855936e4dac63b936fe3/f2/022a27c10d2c4b8097d36881aa483136 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,100 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for c208c138f9bebfcad824fa3fbb7e912a in 227ms, sequenceid=5, compaction requested=false 2023-02-12 06:03:00,103 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for c208c138f9bebfcad824fa3fbb7e912a: 2023-02-12 06:03:00,103 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,103 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 06:03:00,104 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/c208c138f9bebfcad824fa3fbb7e912a/f1/7e64eaebcd674fe6a6482b512c81ff9b] hfiles 2023-02-12 06:03:00,104 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/c208c138f9bebfcad824fa3fbb7e912a/f1/7e64eaebcd674fe6a6482b512c81ff9b for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,104 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/c208c138f9bebfcad824fa3fbb7e912a/f2/da6af60022d94b43a637ec3d4977845c] hfiles 2023-02-12 06:03:00,104 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/c208c138f9bebfcad824fa3fbb7e912a/f2/da6af60022d94b43a637ec3d4977845c for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,106 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/96e1fed3c51e76d3db58034d221e5500/f1/78e3aebfcce24e00843083da6afff755, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 06:03:00,107 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/96e1fed3c51e76d3db58034d221e5500/.tmp/f2/c353a1a1500f4a819596bb5a29beca05 as hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/96e1fed3c51e76d3db58034d221e5500/f2/c353a1a1500f4a819596bb5a29beca05 2023-02-12 06:03:00,117 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/ac4bbab435a2c040bbdb8338c993e6ec/f2/9490c477867c4eea8a2f126fe40ee0a9, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 06:03:00,118 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for ac4bbab435a2c040bbdb8338c993e6ec in 166ms, sequenceid=5, compaction requested=false 2023-02-12 06:03:00,118 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for ac4bbab435a2c040bbdb8338c993e6ec: 2023-02-12 06:03:00,118 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,118 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 06:03:00,118 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/ac4bbab435a2c040bbdb8338c993e6ec/f1/346c1005cc48497287a044bcb69147a2] hfiles 2023-02-12 06:03:00,118 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/ac4bbab435a2c040bbdb8338c993e6ec/f1/346c1005cc48497287a044bcb69147a2 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,118 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/ac4bbab435a2c040bbdb8338c993e6ec/f2/9490c477867c4eea8a2f126fe40ee0a9] hfiles 2023-02-12 06:03:00,118 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/ac4bbab435a2c040bbdb8338c993e6ec/f2/9490c477867c4eea8a2f126fe40ee0a9 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,121 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/96e1fed3c51e76d3db58034d221e5500/f2/c353a1a1500f4a819596bb5a29beca05, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 06:03:00,122 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 96e1fed3c51e76d3db58034d221e5500 in 237ms, sequenceid=5, compaction requested=false 2023-02-12 06:03:00,122 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 96e1fed3c51e76d3db58034d221e5500: 2023-02-12 06:03:00,122 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,122 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 06:03:00,122 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/96e1fed3c51e76d3db58034d221e5500/f1/78e3aebfcce24e00843083da6afff755] hfiles 2023-02-12 06:03:00,122 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/96e1fed3c51e76d3db58034d221e5500/f1/78e3aebfcce24e00843083da6afff755 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,122 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/96e1fed3c51e76d3db58034d221e5500/f2/c353a1a1500f4a819596bb5a29beca05] hfiles 2023-02-12 06:03:00,122 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/96e1fed3c51e76d3db58034d221e5500/f2/c353a1a1500f4a819596bb5a29beca05 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,124 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/7db93b0592a0ffbad72426a53dea531d/f2/054dfcfd9556487eb625b71080808f88, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 06:03:00,125 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 7db93b0592a0ffbad72426a53dea531d in 244ms, sequenceid=5, compaction requested=false 2023-02-12 06:03:00,125 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 7db93b0592a0ffbad72426a53dea531d: 2023-02-12 06:03:00,125 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,125 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 06:03:00,125 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/7db93b0592a0ffbad72426a53dea531d/f1/a60b356808d34ee29a4eee52fc9fe1ac] hfiles 2023-02-12 06:03:00,125 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/7db93b0592a0ffbad72426a53dea531d/f1/a60b356808d34ee29a4eee52fc9fe1ac for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,125 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/7db93b0592a0ffbad72426a53dea531d/f2/054dfcfd9556487eb625b71080808f88] hfiles 2023-02-12 06:03:00,125 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/7db93b0592a0ffbad72426a53dea531d/f2/054dfcfd9556487eb625b71080808f88 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,128 DEBUG [Listener at localhost/40063] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 06:03:00,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45631] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 06:03:00,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45631] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 06:03:00,130 DEBUG [Listener at localhost/40063] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-12 06:03:00,140 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a. completed. 2023-02-12 06:03:00,140 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a. 2023-02-12 06:03:00,140 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b. 2023-02-12 06:03:00,140 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-12 06:03:00,140 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b. started... 2023-02-12 06:03:00,141 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-1] regionserver.HRegion(2744): Flushing bc33ffcdfaec411e24236b6d44e5db2b 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 06:03:00,148 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3. completed. 2023-02-12 06:03:00,148 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3. 2023-02-12 06:03:00,148 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec. completed. 2023-02-12 06:03:00,148 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-12 06:03:00,148 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec. 2023-02-12 06:03:00,148 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507. 2023-02-12 06:03:00,148 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-12 06:03:00,148 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507. started... 2023-02-12 06:03:00,149 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for ec61a0ee1596767b26f9746acbc2e507: 2023-02-12 06:03:00,149 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,149 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 06:03:00,149 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 06:03:00,149 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 06:03:00,164 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/bc33ffcdfaec411e24236b6d44e5db2b/.tmp/f1/46f91f292f89465e8f359699b9aef34d 2023-02-12 06:03:00,171 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507. completed. 2023-02-12 06:03:00,171 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507. 2023-02-12 06:03:00,171 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2. 2023-02-12 06:03:00,171 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-12 06:03:00,171 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2. started... 2023-02-12 06:03:00,171 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 5196f1f5c7fff2336111d751c7d841e2 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 06:03:00,191 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/bc33ffcdfaec411e24236b6d44e5db2b/.tmp/f2/b3b5fb403ee6430c8ebba976cff2bc2c 2023-02-12 06:03:00,191 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/5196f1f5c7fff2336111d751c7d841e2/.tmp/f1/523c602895504d239bc44b2ec918880f 2023-02-12 06:03:00,197 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/bc33ffcdfaec411e24236b6d44e5db2b/.tmp/f1/46f91f292f89465e8f359699b9aef34d as hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/bc33ffcdfaec411e24236b6d44e5db2b/f1/46f91f292f89465e8f359699b9aef34d 2023-02-12 06:03:00,207 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/bc33ffcdfaec411e24236b6d44e5db2b/f1/46f91f292f89465e8f359699b9aef34d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 06:03:00,208 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/bc33ffcdfaec411e24236b6d44e5db2b/.tmp/f2/b3b5fb403ee6430c8ebba976cff2bc2c as hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/bc33ffcdfaec411e24236b6d44e5db2b/f2/b3b5fb403ee6430c8ebba976cff2bc2c 2023-02-12 06:03:00,214 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/bc33ffcdfaec411e24236b6d44e5db2b/f2/b3b5fb403ee6430c8ebba976cff2bc2c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 06:03:00,215 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for bc33ffcdfaec411e24236b6d44e5db2b in 74ms, sequenceid=5, compaction requested=false 2023-02-12 06:03:00,216 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for bc33ffcdfaec411e24236b6d44e5db2b: 2023-02-12 06:03:00,216 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,216 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 06:03:00,216 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/bc33ffcdfaec411e24236b6d44e5db2b/f1/46f91f292f89465e8f359699b9aef34d] hfiles 2023-02-12 06:03:00,216 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/bc33ffcdfaec411e24236b6d44e5db2b/f1/46f91f292f89465e8f359699b9aef34d for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,216 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/bc33ffcdfaec411e24236b6d44e5db2b/f2/b3b5fb403ee6430c8ebba976cff2bc2c] hfiles 2023-02-12 06:03:00,216 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/bc33ffcdfaec411e24236b6d44e5db2b/f2/b3b5fb403ee6430c8ebba976cff2bc2c for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,220 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/5196f1f5c7fff2336111d751c7d841e2/.tmp/f2/a49b419b0bc44a05b0b6acaa72650290 2023-02-12 06:03:00,226 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/5196f1f5c7fff2336111d751c7d841e2/.tmp/f1/523c602895504d239bc44b2ec918880f as hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/5196f1f5c7fff2336111d751c7d841e2/f1/523c602895504d239bc44b2ec918880f 2023-02-12 06:03:00,230 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/5196f1f5c7fff2336111d751c7d841e2/f1/523c602895504d239bc44b2ec918880f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 06:03:00,231 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/5196f1f5c7fff2336111d751c7d841e2/.tmp/f2/a49b419b0bc44a05b0b6acaa72650290 as hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/5196f1f5c7fff2336111d751c7d841e2/f2/a49b419b0bc44a05b0b6acaa72650290 2023-02-12 06:03:00,244 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b. completed. 2023-02-12 06:03:00,244 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b. 2023-02-12 06:03:00,244 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-12 06:03:00,245 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/5196f1f5c7fff2336111d751c7d841e2/f2/a49b419b0bc44a05b0b6acaa72650290, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 06:03:00,246 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 5196f1f5c7fff2336111d751c7d841e2 in 75ms, sequenceid=5, compaction requested=false 2023-02-12 06:03:00,246 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 5196f1f5c7fff2336111d751c7d841e2: 2023-02-12 06:03:00,246 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,246 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 06:03:00,246 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/5196f1f5c7fff2336111d751c7d841e2/f1/523c602895504d239bc44b2ec918880f] hfiles 2023-02-12 06:03:00,246 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/5196f1f5c7fff2336111d751c7d841e2/f1/523c602895504d239bc44b2ec918880f for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,246 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/5196f1f5c7fff2336111d751c7d841e2/f2/a49b419b0bc44a05b0b6acaa72650290] hfiles 2023-02-12 06:03:00,246 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/5196f1f5c7fff2336111d751c7d841e2/f2/a49b419b0bc44a05b0b6acaa72650290 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,258 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2. completed. 2023-02-12 06:03:00,258 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2. 2023-02-12 06:03:00,258 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-12 06:03:00,350 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/1d974d28b432221ca9ffde441bf98fb2/.tmp/f1/fb69119bca724065a36924353665ca18 2023-02-12 06:03:00,366 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/1d974d28b432221ca9ffde441bf98fb2/.tmp/f2/35daa0f53c7c4e53b7e6238f646314b7 2023-02-12 06:03:00,371 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/1d974d28b432221ca9ffde441bf98fb2/.tmp/f1/fb69119bca724065a36924353665ca18 as hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/1d974d28b432221ca9ffde441bf98fb2/f1/fb69119bca724065a36924353665ca18 2023-02-12 06:03:00,376 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/1d974d28b432221ca9ffde441bf98fb2/f1/fb69119bca724065a36924353665ca18, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 06:03:00,377 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/1d974d28b432221ca9ffde441bf98fb2/.tmp/f2/35daa0f53c7c4e53b7e6238f646314b7 as hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/1d974d28b432221ca9ffde441bf98fb2/f2/35daa0f53c7c4e53b7e6238f646314b7 2023-02-12 06:03:00,383 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/1d974d28b432221ca9ffde441bf98fb2/f2/35daa0f53c7c4e53b7e6238f646314b7, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 06:03:00,384 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 1d974d28b432221ca9ffde441bf98fb2 in 499ms, sequenceid=5, compaction requested=false 2023-02-12 06:03:00,384 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 1d974d28b432221ca9ffde441bf98fb2: 2023-02-12 06:03:00,384 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,384 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 06:03:00,384 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/1d974d28b432221ca9ffde441bf98fb2/f1/fb69119bca724065a36924353665ca18] hfiles 2023-02-12 06:03:00,384 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/1d974d28b432221ca9ffde441bf98fb2/f1/fb69119bca724065a36924353665ca18 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,384 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/1d974d28b432221ca9ffde441bf98fb2/f2/35daa0f53c7c4e53b7e6238f646314b7] hfiles 2023-02-12 06:03:00,384 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/1d974d28b432221ca9ffde441bf98fb2/f2/35daa0f53c7c4e53b7e6238f646314b7 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,390 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2. completed. 2023-02-12 06:03:00,390 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2. 2023-02-12 06:03:00,390 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-12 06:03:00,390 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-12 06:03:00,391 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:03:00,391 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-12 06:03:00,391 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,37181,1676181777204' in zk 2023-02-12 06:03:00,392 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-12 06:03:00,392 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:03:00,392 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:03:00,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:03:00,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:00,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 06:03:00,392 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-12 06:03:00,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:00,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:00,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:03:00,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:03:00,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:00,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:03:00,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,37181,1676181777204': 2023-02-12 06:03:00,397 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37181,1676181777204' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-12 06:03:00,430 DEBUG [Listener at localhost/40063] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 06:03:00,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45631] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 06:03:00,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45631] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 06:03:00,432 DEBUG [Listener at localhost/40063] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-12 06:03:00,555 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d. completed. 2023-02-12 06:03:00,555 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d. 2023-02-12 06:03:00,555 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-12 06:03:00,555 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500. completed. 2023-02-12 06:03:00,555 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500. 2023-02-12 06:03:00,555 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-12 06:03:00,555 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-12 06:03:00,555 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:03:00,555 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-12 06:03:00,555 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,42183,1676181777167' in zk 2023-02-12 06:03:00,557 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:03:00,557 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-12 06:03:00,557 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:03:00,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:03:00,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:00,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 06:03:00,557 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-12 06:03:00,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:00,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:00,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:03:00,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:03:00,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:00,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:03:00,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:03:00,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,42183,1676181777167': 2023-02-12 06:03:00,562 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42183,1676181777167' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-12 06:03:00,562 INFO [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-12 06:03:00,562 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 06:03:00,562 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 06:03:00,562 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,562 INFO [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-12 06:03:00,564 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,564 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): regionserver:42183-0x1004720144c0001, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:00,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 06:03:00,564 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): regionserver:37181-0x1004720144c0002, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,564 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): regionserver:42183-0x1004720144c0001, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 06:03:00,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:00,564 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): regionserver:37181-0x1004720144c0002, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 06:03:00,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,565 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:03:00,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 06:03:00,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:03:00,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 06:03:00,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:03:00,565 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:03:00,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:00,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:03:00,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:03:00,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:00,567 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:03:00,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,567 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:03:00,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:03:00,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:03:00,573 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:03:00,573 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,574 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:03:00,574 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,574 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): regionserver:37181-0x1004720144c0002, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 06:03:00,574 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): regionserver:42183-0x1004720144c0001, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 06:03:00,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 06:03:00,574 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): regionserver:42183-0x1004720144c0001, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 06:03:00,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:03:00,574 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): regionserver:37181-0x1004720144c0002, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 06:03:00,574 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:03:00,574 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,574 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:03:00,574 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 06:03:00,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:03:00,574 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 06:03:00,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:03:00,575 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:03:00,575 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,575 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 06:03:00,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:03:00,576 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,813 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,834 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-12 06:03:00,834 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,834 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:00,834 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676181779819Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676181780574 (+755 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1676181780575 (+1 ms)Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1676181780790 (+215 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676181780801 (+11 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1676181780834 (+33 ms) 2023-02-12 06:03:00,836 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 06:03:00,838 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.0170 sec 2023-02-12 06:03:00,932 DEBUG [Listener at localhost/40063] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 06:03:00,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45631] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 06:03:00,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45631] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-12 06:03:00,934 INFO [Listener at localhost/40063] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-12 06:03:00,939 INFO [Listener at localhost/40063] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-12 06:03:00,948 INFO [Listener at localhost/40063] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-12 06:03:01,000 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42183] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8112 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500. 2023-02-12 06:03:01,002 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37181] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 9464 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a. 2023-02-12 06:03:01,082 INFO [Listener at localhost/40063] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-12 06:03:01,088 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45631] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-12 06:03:01,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45631] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-12 06:03:01,092 INFO [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-12 06:03:01,092 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 06:03:01,093 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-12 06:03:01,093 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-12 06:03:01,094 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:03:01,094 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 06:03:01,095 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): regionserver:37181-0x1004720144c0002, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 06:03:01,095 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): regionserver:42183-0x1004720144c0001, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 06:03:01,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 06:03:01,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 06:03:01,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:03:01,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:03:01,095 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:03:01,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 06:03:01,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 06:03:01,096 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:03:01,096 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:03:01,096 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37181-0x1004720144c0002, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:03:01,096 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42183-0x1004720144c0001, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:03:01,097 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:03:01,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 06:03:01,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 06:03:01,097 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 06:03:01,097 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-12 06:03:01,097 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-12 06:03:01,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 06:03:01,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 06:03:01,098 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-12 06:03:01,098 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-12 06:03:01,098 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 06:03:01,100 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-12 06:03:01,100 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-12 06:03:01,104 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6. 2023-02-12 06:03:01,104 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6. started... 2023-02-12 06:03:01,104 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-12 06:03:01,104 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-12 06:03:01,104 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 06:03:01,104 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 06:03:01,104 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a. 2023-02-12 06:03:01,105 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-12 06:03:01,105 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a. started... 2023-02-12 06:03:01,104 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2. 2023-02-12 06:03:01,105 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2. started... 2023-02-12 06:03:01,105 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing c208c138f9bebfcad824fa3fbb7e912a 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-12 06:03:01,105 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d. 2023-02-12 06:03:01,104 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 67a4fa90e2183d009f14b0952284dab6: 2023-02-12 06:03:01,105 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d. started... 2023-02-12 06:03:01,105 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 1d974d28b432221ca9ffde441bf98fb2 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 06:03:01,105 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7db93b0592a0ffbad72426a53dea531d 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 06:03:01,105 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6. 2023-02-12 06:03:01,108 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500. 2023-02-12 06:03:01,108 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500. started... 2023-02-12 06:03:01,108 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 96e1fed3c51e76d3db58034d221e5500 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 06:03:01,112 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-12 06:03:01,112 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec. 2023-02-12 06:03:01,113 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-12 06:03:01,112 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 06:03:01,113 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec. started... 2023-02-12 06:03:01,113 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3. 2023-02-12 06:03:01,114 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3. started... 2023-02-12 06:03:01,114 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing ac4bbab435a2c040bbdb8338c993e6ec 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-12 06:03:01,114 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 0791c9d76ddc855936e4dac63b936fe3 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 06:03:01,162 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/96e1fed3c51e76d3db58034d221e5500/.tmp/f1/a32f79879d134ddb84534693b33c72f6 2023-02-12 06:03:01,162 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/c208c138f9bebfcad824fa3fbb7e912a/.tmp/f1/be08c7c83dfa4f098864758d3e359818 2023-02-12 06:03:01,164 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/1d974d28b432221ca9ffde441bf98fb2/.tmp/f1/9a2d43b4d22c4c2f9eb436a225d33ee3 2023-02-12 06:03:01,168 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/0791c9d76ddc855936e4dac63b936fe3/.tmp/f1/4d4fcd484e874fb2bbd7c365af6dec11 2023-02-12 06:03:01,175 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/7db93b0592a0ffbad72426a53dea531d/.tmp/f1/8662d1bb99e24d20bb804bc2eb125ef2 2023-02-12 06:03:01,176 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/ac4bbab435a2c040bbdb8338c993e6ec/.tmp/f1/7702042f842b4c60906445a5a8590a34 2023-02-12 06:03:01,220 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/c208c138f9bebfcad824fa3fbb7e912a/.tmp/f2/bd15530516b2413c99355431fb4e7785 2023-02-12 06:03:01,230 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/96e1fed3c51e76d3db58034d221e5500/.tmp/f2/a36c316d010f4bd597f8a3a69b52ff3d 2023-02-12 06:03:01,236 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/0791c9d76ddc855936e4dac63b936fe3/.tmp/f2/e0d05e7318b749e692e42a1d5645d97f 2023-02-12 06:03:01,244 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/0791c9d76ddc855936e4dac63b936fe3/.tmp/f1/4d4fcd484e874fb2bbd7c365af6dec11 as hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/0791c9d76ddc855936e4dac63b936fe3/f1/4d4fcd484e874fb2bbd7c365af6dec11 2023-02-12 06:03:01,245 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/7db93b0592a0ffbad72426a53dea531d/.tmp/f2/01237de6d0a046e3b975dd384328f5ba 2023-02-12 06:03:01,245 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/96e1fed3c51e76d3db58034d221e5500/.tmp/f1/a32f79879d134ddb84534693b33c72f6 as hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/96e1fed3c51e76d3db58034d221e5500/f1/a32f79879d134ddb84534693b33c72f6 2023-02-12 06:03:01,245 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/c208c138f9bebfcad824fa3fbb7e912a/.tmp/f1/be08c7c83dfa4f098864758d3e359818 as hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/c208c138f9bebfcad824fa3fbb7e912a/f1/be08c7c83dfa4f098864758d3e359818 2023-02-12 06:03:01,252 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/7db93b0592a0ffbad72426a53dea531d/.tmp/f1/8662d1bb99e24d20bb804bc2eb125ef2 as hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/7db93b0592a0ffbad72426a53dea531d/f1/8662d1bb99e24d20bb804bc2eb125ef2 2023-02-12 06:03:01,253 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/ac4bbab435a2c040bbdb8338c993e6ec/.tmp/f2/299de896f5d74376a16fd725487cec6a 2023-02-12 06:03:01,255 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/c208c138f9bebfcad824fa3fbb7e912a/f1/be08c7c83dfa4f098864758d3e359818, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 06:03:01,256 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/96e1fed3c51e76d3db58034d221e5500/f1/a32f79879d134ddb84534693b33c72f6, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 06:03:01,256 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/c208c138f9bebfcad824fa3fbb7e912a/.tmp/f2/bd15530516b2413c99355431fb4e7785 as hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/c208c138f9bebfcad824fa3fbb7e912a/f2/bd15530516b2413c99355431fb4e7785 2023-02-12 06:03:01,258 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/0791c9d76ddc855936e4dac63b936fe3/f1/4d4fcd484e874fb2bbd7c365af6dec11, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 06:03:01,258 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/96e1fed3c51e76d3db58034d221e5500/.tmp/f2/a36c316d010f4bd597f8a3a69b52ff3d as hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/96e1fed3c51e76d3db58034d221e5500/f2/a36c316d010f4bd597f8a3a69b52ff3d 2023-02-12 06:03:01,260 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/7db93b0592a0ffbad72426a53dea531d/f1/8662d1bb99e24d20bb804bc2eb125ef2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 06:03:01,260 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/0791c9d76ddc855936e4dac63b936fe3/.tmp/f2/e0d05e7318b749e692e42a1d5645d97f as hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/0791c9d76ddc855936e4dac63b936fe3/f2/e0d05e7318b749e692e42a1d5645d97f 2023-02-12 06:03:01,262 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/ac4bbab435a2c040bbdb8338c993e6ec/.tmp/f1/7702042f842b4c60906445a5a8590a34 as hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/ac4bbab435a2c040bbdb8338c993e6ec/f1/7702042f842b4c60906445a5a8590a34 2023-02-12 06:03:01,262 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/7db93b0592a0ffbad72426a53dea531d/.tmp/f2/01237de6d0a046e3b975dd384328f5ba as hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/7db93b0592a0ffbad72426a53dea531d/f2/01237de6d0a046e3b975dd384328f5ba 2023-02-12 06:03:01,266 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/c208c138f9bebfcad824fa3fbb7e912a/f2/bd15530516b2413c99355431fb4e7785, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 06:03:01,267 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for c208c138f9bebfcad824fa3fbb7e912a in 162ms, sequenceid=9, compaction requested=false 2023-02-12 06:03:01,267 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for c208c138f9bebfcad824fa3fbb7e912a: 2023-02-12 06:03:01,267 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a. 2023-02-12 06:03:01,267 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b. 2023-02-12 06:03:01,267 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-12 06:03:01,267 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b. started... 2023-02-12 06:03:01,267 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing bc33ffcdfaec411e24236b6d44e5db2b 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 06:03:01,267 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/96e1fed3c51e76d3db58034d221e5500/f2/a36c316d010f4bd597f8a3a69b52ff3d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 06:03:01,269 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/ac4bbab435a2c040bbdb8338c993e6ec/f1/7702042f842b4c60906445a5a8590a34, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 06:03:01,270 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/ac4bbab435a2c040bbdb8338c993e6ec/.tmp/f2/299de896f5d74376a16fd725487cec6a as hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/ac4bbab435a2c040bbdb8338c993e6ec/f2/299de896f5d74376a16fd725487cec6a 2023-02-12 06:03:01,270 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/0791c9d76ddc855936e4dac63b936fe3/f2/e0d05e7318b749e692e42a1d5645d97f, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 06:03:01,281 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 0791c9d76ddc855936e4dac63b936fe3 in 167ms, sequenceid=9, compaction requested=false 2023-02-12 06:03:01,281 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 96e1fed3c51e76d3db58034d221e5500 in 173ms, sequenceid=9, compaction requested=false 2023-02-12 06:03:01,281 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 0791c9d76ddc855936e4dac63b936fe3: 2023-02-12 06:03:01,281 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 96e1fed3c51e76d3db58034d221e5500: 2023-02-12 06:03:01,281 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3. 2023-02-12 06:03:01,281 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500. 2023-02-12 06:03:01,281 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-12 06:03:01,281 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2. 2023-02-12 06:03:01,281 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507. 2023-02-12 06:03:01,281 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2. started... 2023-02-12 06:03:01,281 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-12 06:03:01,281 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507. started... 2023-02-12 06:03:01,281 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 5196f1f5c7fff2336111d751c7d841e2 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 06:03:01,282 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for ec61a0ee1596767b26f9746acbc2e507: 2023-02-12 06:03:01,282 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507. 2023-02-12 06:03:01,282 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-12 06:03:01,307 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/7db93b0592a0ffbad72426a53dea531d/f2/01237de6d0a046e3b975dd384328f5ba, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 06:03:01,308 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 7db93b0592a0ffbad72426a53dea531d in 203ms, sequenceid=9, compaction requested=false 2023-02-12 06:03:01,308 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7db93b0592a0ffbad72426a53dea531d: 2023-02-12 06:03:01,308 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d. 2023-02-12 06:03:01,308 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-12 06:03:01,308 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/ac4bbab435a2c040bbdb8338c993e6ec/f2/299de896f5d74376a16fd725487cec6a, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 06:03:01,309 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for ac4bbab435a2c040bbdb8338c993e6ec in 195ms, sequenceid=9, compaction requested=false 2023-02-12 06:03:01,309 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for ac4bbab435a2c040bbdb8338c993e6ec: 2023-02-12 06:03:01,309 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec. 2023-02-12 06:03:01,309 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-12 06:03:01,332 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/bc33ffcdfaec411e24236b6d44e5db2b/.tmp/f1/76620e9c232342f693eeaf46038d46bd 2023-02-12 06:03:01,345 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/5196f1f5c7fff2336111d751c7d841e2/.tmp/f1/798e3ebc99b741f78b738bb1ac988c86 2023-02-12 06:03:01,348 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/bc33ffcdfaec411e24236b6d44e5db2b/.tmp/f2/476c4a5700f04d85af57b0edf26dbda2 2023-02-12 06:03:01,355 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/bc33ffcdfaec411e24236b6d44e5db2b/.tmp/f1/76620e9c232342f693eeaf46038d46bd as hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/bc33ffcdfaec411e24236b6d44e5db2b/f1/76620e9c232342f693eeaf46038d46bd 2023-02-12 06:03:01,360 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/bc33ffcdfaec411e24236b6d44e5db2b/f1/76620e9c232342f693eeaf46038d46bd, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 06:03:01,360 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/bc33ffcdfaec411e24236b6d44e5db2b/.tmp/f2/476c4a5700f04d85af57b0edf26dbda2 as hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/bc33ffcdfaec411e24236b6d44e5db2b/f2/476c4a5700f04d85af57b0edf26dbda2 2023-02-12 06:03:01,365 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/bc33ffcdfaec411e24236b6d44e5db2b/f2/476c4a5700f04d85af57b0edf26dbda2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 06:03:01,366 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for bc33ffcdfaec411e24236b6d44e5db2b in 99ms, sequenceid=9, compaction requested=false 2023-02-12 06:03:01,366 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for bc33ffcdfaec411e24236b6d44e5db2b: 2023-02-12 06:03:01,366 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b. 2023-02-12 06:03:01,366 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-12 06:03:01,378 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/5196f1f5c7fff2336111d751c7d841e2/.tmp/f2/217b17bfc0e64763b03c754b994f3519 2023-02-12 06:03:01,384 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/5196f1f5c7fff2336111d751c7d841e2/.tmp/f1/798e3ebc99b741f78b738bb1ac988c86 as hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/5196f1f5c7fff2336111d751c7d841e2/f1/798e3ebc99b741f78b738bb1ac988c86 2023-02-12 06:03:01,390 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/5196f1f5c7fff2336111d751c7d841e2/f1/798e3ebc99b741f78b738bb1ac988c86, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 06:03:01,391 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/5196f1f5c7fff2336111d751c7d841e2/.tmp/f2/217b17bfc0e64763b03c754b994f3519 as hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/5196f1f5c7fff2336111d751c7d841e2/f2/217b17bfc0e64763b03c754b994f3519 2023-02-12 06:03:01,396 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/5196f1f5c7fff2336111d751c7d841e2/f2/217b17bfc0e64763b03c754b994f3519, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 06:03:01,397 INFO [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 5196f1f5c7fff2336111d751c7d841e2 in 116ms, sequenceid=9, compaction requested=false 2023-02-12 06:03:01,397 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 5196f1f5c7fff2336111d751c7d841e2: 2023-02-12 06:03:01,397 DEBUG [rs(jenkins-hbase4.apache.org,42183,1676181777167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2. 2023-02-12 06:03:01,398 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-12 06:03:01,398 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-12 06:03:01,398 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:03:01,398 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-12 06:03:01,398 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42183,1676181777167' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-12 06:03:01,399 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 06:03:01,399 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:03:01,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:03:01,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:01,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 06:03:01,400 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42183-0x1004720144c0001, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 06:03:01,400 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 06:03:01,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:01,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:01,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 06:03:01,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:03:01,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:01,401 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42183,1676181777167' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-12 06:03:01,401 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c60754a[Count = 1] remaining members to acquire global barrier 2023-02-12 06:03:01,629 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/1d974d28b432221ca9ffde441bf98fb2/.tmp/f2/6767d50c9cf24f408ab4c8b3352a98b0 2023-02-12 06:03:01,635 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/1d974d28b432221ca9ffde441bf98fb2/.tmp/f1/9a2d43b4d22c4c2f9eb436a225d33ee3 as hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/1d974d28b432221ca9ffde441bf98fb2/f1/9a2d43b4d22c4c2f9eb436a225d33ee3 2023-02-12 06:03:01,640 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/1d974d28b432221ca9ffde441bf98fb2/f1/9a2d43b4d22c4c2f9eb436a225d33ee3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 06:03:01,641 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/1d974d28b432221ca9ffde441bf98fb2/.tmp/f2/6767d50c9cf24f408ab4c8b3352a98b0 as hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/1d974d28b432221ca9ffde441bf98fb2/f2/6767d50c9cf24f408ab4c8b3352a98b0 2023-02-12 06:03:01,646 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/1d974d28b432221ca9ffde441bf98fb2/f2/6767d50c9cf24f408ab4c8b3352a98b0, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 06:03:01,647 INFO [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 1d974d28b432221ca9ffde441bf98fb2 in 542ms, sequenceid=9, compaction requested=false 2023-02-12 06:03:01,647 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 1d974d28b432221ca9ffde441bf98fb2: 2023-02-12 06:03:01,647 DEBUG [rs(jenkins-hbase4.apache.org,37181,1676181777204)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2. 2023-02-12 06:03:01,647 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-12 06:03:01,647 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-12 06:03:01,647 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:03:01,647 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-12 06:03:01,647 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37181,1676181777204' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-12 06:03:01,650 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 06:03:01,650 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:03:01,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:03:01,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:01,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 06:03:01,650 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37181-0x1004720144c0002, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 06:03:01,650 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 06:03:01,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:01,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:01,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 06:03:01,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:03:01,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:03:01,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:01,652 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37181,1676181777204' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-12 06:03:01,652 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c60754a[Count = 0] remaining members to acquire global barrier 2023-02-12 06:03:01,652 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-12 06:03:01,652 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 06:03:01,653 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): regionserver:37181-0x1004720144c0002, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 06:03:01,653 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): regionserver:42183-0x1004720144c0001, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 06:03:01,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 06:03:01,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 06:03:01,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 06:03:01,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 06:03:01,653 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:03:01,653 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-12 06:03:01,654 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-12 06:03:01,654 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-12 06:03:01,654 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-12 06:03:01,654 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,42183,1676181777167' in zk 2023-02-12 06:03:01,654 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,37181,1676181777204' in zk 2023-02-12 06:03:01,654 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:03:01,654 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 06:03:01,655 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-12 06:03:01,655 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:03:01,655 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:03:01,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:03:01,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:01,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 06:03:01,655 DEBUG [member: 'jenkins-hbase4.apache.org,37181,1676181777204' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-12 06:03:01,656 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-12 06:03:01,656 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:03:01,656 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:03:01,656 DEBUG [member: 'jenkins-hbase4.apache.org,42183,1676181777167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-12 06:03:01,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:01,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:01,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 06:03:01,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:03:01,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:03:01,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:01,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 06:03:01,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:03:01,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:03:01,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,37181,1676181777204': 2023-02-12 06:03:01,660 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37181,1676181777204' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-12 06:03:01,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:03:01,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:01,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 06:03:01,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:01,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:01,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 06:03:01,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:03:01,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:03:01,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:01,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 06:03:01,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:03:01,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:03:01,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,42183,1676181777167': 2023-02-12 06:03:01,663 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42183,1676181777167' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-12 06:03:01,663 INFO [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-12 06:03:01,663 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 06:03:01,663 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 06:03:01,663 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-12 06:03:01,663 INFO [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 06:03:01,665 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:03:01,665 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): regionserver:42183-0x1004720144c0001, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:03:01,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:03:01,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:03:01,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:03:01,665 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): regionserver:37181-0x1004720144c0002, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:03:01,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:01,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:03:01,666 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): regionserver:42183-0x1004720144c0001, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 06:03:01,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:03:01,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 06:03:01,666 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): regionserver:37181-0x1004720144c0002, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 06:03:01,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 06:03:01,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:03:01,666 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:03:01,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 06:03:01,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:03:01,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:01,667 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:03:01,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:03:01,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:03:01,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 06:03:01,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:01,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 06:03:01,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:03:01,668 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:03:01,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:03:01,668 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:03:01,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:01,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 06:03:01,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:03:01,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:03:01,673 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:03:01,673 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): regionserver:42183-0x1004720144c0001, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 06:03:01,673 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 06:03:01,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 06:03:01,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:03:01,673 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): regionserver:42183-0x1004720144c0001, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 06:03:01,673 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:03:01,673 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): regionserver:37181-0x1004720144c0002, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 06:03:01,673 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 06:03:01,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 06:03:01,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:03:01,673 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45631] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-12 06:03:01,673 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45631] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 06:03:01,673 DEBUG [(jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:03:01,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 06:03:01,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:03:01,673 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:03:01,674 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 06:03:01,674 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:03:01,674 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 06:03:01,674 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:03:01,673 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): regionserver:37181-0x1004720144c0002, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 06:03:01,674 DEBUG [Listener at localhost/40063] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-12 06:03:01,675 DEBUG [Listener at localhost/40063] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 06:03:01,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 06:03:01,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:03:01,775 DEBUG [Listener at localhost/40063] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 06:03:01,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45631] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 06:03:01,777 INFO [Listener at localhost/40063] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 06:03:01,777 DEBUG [Listener at localhost/40063] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f070997 to 127.0.0.1:61935 2023-02-12 06:03:01,777 DEBUG [Listener at localhost/40063] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:01,777 DEBUG [Listener at localhost/40063] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-12 06:03:01,778 DEBUG [Listener at localhost/40063] util.JVMClusterUtil(257): Found active master hash=926812409, stopped=false 2023-02-12 06:03:01,778 INFO [Listener at localhost/40063] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,45631,1676181777071 2023-02-12 06:03:01,779 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): regionserver:37181-0x1004720144c0002, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 06:03:01,779 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): regionserver:42183-0x1004720144c0001, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 06:03:01,779 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 06:03:01,779 INFO [Listener at localhost/40063] procedure2.ProcedureExecutor(629): Stopping 2023-02-12 06:03:01,779 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:01,780 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42183-0x1004720144c0001, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:03:01,781 DEBUG [Listener at localhost/40063] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x153698ee to 127.0.0.1:61935 2023-02-12 06:03:01,781 DEBUG [Listener at localhost/40063] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:01,781 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37181-0x1004720144c0002, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:03:01,781 INFO [Listener at localhost/40063] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42183,1676181777167' ***** 2023-02-12 06:03:01,781 INFO [Listener at localhost/40063] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 06:03:01,781 INFO [Listener at localhost/40063] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,37181,1676181777204' ***** 2023-02-12 06:03:01,781 INFO [Listener at localhost/40063] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 06:03:01,781 INFO [RS:0;jenkins-hbase4:42183] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 06:03:01,782 INFO [RS:1;jenkins-hbase4:37181] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 06:03:01,782 INFO [RS:0;jenkins-hbase4:42183] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 06:03:01,782 INFO [RS:1;jenkins-hbase4:37181] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 06:03:01,782 INFO [RS:1;jenkins-hbase4:37181] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 06:03:01,782 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 06:03:01,782 INFO [RS:1;jenkins-hbase4:37181] regionserver.HRegionServer(3304): Received CLOSE for 67a4fa90e2183d009f14b0952284dab6 2023-02-12 06:03:01,783 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 06:03:01,782 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:03:01,782 INFO [RS:0;jenkins-hbase4:42183] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 06:03:01,784 INFO [RS:0;jenkins-hbase4:42183] regionserver.HRegionServer(3304): Received CLOSE for 7db93b0592a0ffbad72426a53dea531d 2023-02-12 06:03:01,784 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 06:03:01,784 INFO [RS:0;jenkins-hbase4:42183] regionserver.HRegionServer(3304): Received CLOSE for 70962f2f424e7a6feeef8d88d58ef25d 2023-02-12 06:03:01,785 INFO [RS:1;jenkins-hbase4:37181] regionserver.HRegionServer(3304): Received CLOSE for c208c138f9bebfcad824fa3fbb7e912a 2023-02-12 06:03:01,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7db93b0592a0ffbad72426a53dea531d, disabling compactions & flushes 2023-02-12 06:03:01,785 INFO [RS:0;jenkins-hbase4:42183] regionserver.HRegionServer(3304): Received CLOSE for 96e1fed3c51e76d3db58034d221e5500 2023-02-12 06:03:01,785 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d. 2023-02-12 06:03:01,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 67a4fa90e2183d009f14b0952284dab6, disabling compactions & flushes 2023-02-12 06:03:01,785 INFO [RS:1;jenkins-hbase4:37181] regionserver.HRegionServer(3304): Received CLOSE for 1d974d28b432221ca9ffde441bf98fb2 2023-02-12 06:03:01,785 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 06:03:01,785 INFO [RS:1;jenkins-hbase4:37181] regionserver.HRegionServer(3304): Received CLOSE for ac4bbab435a2c040bbdb8338c993e6ec 2023-02-12 06:03:01,785 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6. 2023-02-12 06:03:01,786 INFO [RS:1;jenkins-hbase4:37181] regionserver.HRegionServer(3304): Received CLOSE for bc33ffcdfaec411e24236b6d44e5db2b 2023-02-12 06:03:01,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d. 2023-02-12 06:03:01,785 INFO [RS:0;jenkins-hbase4:42183] regionserver.HRegionServer(3304): Received CLOSE for 0791c9d76ddc855936e4dac63b936fe3 2023-02-12 06:03:01,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d. after waiting 0 ms 2023-02-12 06:03:01,786 INFO [RS:0;jenkins-hbase4:42183] regionserver.HRegionServer(3304): Received CLOSE for ec61a0ee1596767b26f9746acbc2e507 2023-02-12 06:03:01,786 INFO [RS:1;jenkins-hbase4:37181] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:03:01,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6. 2023-02-12 06:03:01,786 DEBUG [RS:1;jenkins-hbase4:37181] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x32190e9c to 127.0.0.1:61935 2023-02-12 06:03:01,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6. after waiting 0 ms 2023-02-12 06:03:01,786 DEBUG [RS:1;jenkins-hbase4:37181] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:01,786 INFO [RS:0;jenkins-hbase4:42183] regionserver.HRegionServer(3304): Received CLOSE for 5196f1f5c7fff2336111d751c7d841e2 2023-02-12 06:03:01,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d. 2023-02-12 06:03:01,786 INFO [RS:0;jenkins-hbase4:42183] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:03:01,786 INFO [RS:1;jenkins-hbase4:37181] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 06:03:01,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6. 2023-02-12 06:03:01,786 INFO [RS:1;jenkins-hbase4:37181] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 06:03:01,786 INFO [RS:1;jenkins-hbase4:37181] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 06:03:01,786 DEBUG [RS:0;jenkins-hbase4:42183] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33c811c2 to 127.0.0.1:61935 2023-02-12 06:03:01,787 INFO [RS:1;jenkins-hbase4:37181] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-12 06:03:01,787 DEBUG [RS:0;jenkins-hbase4:42183] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:01,788 INFO [RS:0;jenkins-hbase4:42183] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-12 06:03:01,788 DEBUG [RS:0;jenkins-hbase4:42183] regionserver.HRegionServer(1479): Online Regions={7db93b0592a0ffbad72426a53dea531d=testWithMapReduce,m\xED\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d., 70962f2f424e7a6feeef8d88d58ef25d=hbase:namespace,,1676181777873.70962f2f424e7a6feeef8d88d58ef25d., 96e1fed3c51e76d3db58034d221e5500=testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500., 0791c9d76ddc855936e4dac63b936fe3=testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3., ec61a0ee1596767b26f9746acbc2e507=testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507., 5196f1f5c7fff2336111d751c7d841e2=testWithMapReduce,g\xA7\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2.} 2023-02-12 06:03:01,788 DEBUG [RS:0;jenkins-hbase4:42183] regionserver.HRegionServer(1505): Waiting on 0791c9d76ddc855936e4dac63b936fe3, 5196f1f5c7fff2336111d751c7d841e2, 70962f2f424e7a6feeef8d88d58ef25d, 7db93b0592a0ffbad72426a53dea531d, 96e1fed3c51e76d3db58034d221e5500, ec61a0ee1596767b26f9746acbc2e507 2023-02-12 06:03:01,788 INFO [RS:1;jenkins-hbase4:37181] regionserver.HRegionServer(1475): Waiting on 6 regions to close 2023-02-12 06:03:01,790 DEBUG [RS:1;jenkins-hbase4:37181] regionserver.HRegionServer(1479): Online Regions={67a4fa90e2183d009f14b0952284dab6=testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6., c208c138f9bebfcad824fa3fbb7e912a=testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a., 1d974d28b432221ca9ffde441bf98fb2=testWithMapReduce,j\xCA\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2., 1588230740=hbase:meta,,1.1588230740, ac4bbab435a2c040bbdb8338c993e6ec=testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec., bc33ffcdfaec411e24236b6d44e5db2b=testWithMapReduce,q\x11\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b.} 2023-02-12 06:03:01,790 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 06:03:01,790 DEBUG [RS:1;jenkins-hbase4:37181] regionserver.HRegionServer(1505): Waiting on 1588230740, 1d974d28b432221ca9ffde441bf98fb2, 67a4fa90e2183d009f14b0952284dab6, ac4bbab435a2c040bbdb8338c993e6ec, bc33ffcdfaec411e24236b6d44e5db2b, c208c138f9bebfcad824fa3fbb7e912a 2023-02-12 06:03:01,790 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 06:03:01,791 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 06:03:01,791 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 06:03:01,791 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 06:03:01,792 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.95 KB heapSize=23.05 KB 2023-02-12 06:03:01,798 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/7db93b0592a0ffbad72426a53dea531d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 06:03:01,800 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d. 2023-02-12 06:03:01,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7db93b0592a0ffbad72426a53dea531d: Waiting for close lock at 1676181781785Running coprocessor pre-close hooks at 1676181781785Disabling compacts and flushes for region at 1676181781785Disabling writes for close at 1676181781786 (+1 ms)Writing region close event to WAL at 1676181781793 (+7 ms)Running coprocessor post-close hooks at 1676181781799 (+6 ms)Closed at 1676181781799 2023-02-12 06:03:01,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d. 2023-02-12 06:03:01,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 70962f2f424e7a6feeef8d88d58ef25d, disabling compactions & flushes 2023-02-12 06:03:01,800 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676181777873.70962f2f424e7a6feeef8d88d58ef25d. 2023-02-12 06:03:01,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676181777873.70962f2f424e7a6feeef8d88d58ef25d. 2023-02-12 06:03:01,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676181777873.70962f2f424e7a6feeef8d88d58ef25d. after waiting 0 ms 2023-02-12 06:03:01,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676181777873.70962f2f424e7a6feeef8d88d58ef25d. 2023-02-12 06:03:01,800 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 70962f2f424e7a6feeef8d88d58ef25d 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-12 06:03:01,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/67a4fa90e2183d009f14b0952284dab6/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-12 06:03:01,802 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6. 2023-02-12 06:03:01,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 67a4fa90e2183d009f14b0952284dab6: Waiting for close lock at 1676181781785Running coprocessor pre-close hooks at 1676181781785Disabling compacts and flushes for region at 1676181781785Disabling writes for close at 1676181781786 (+1 ms)Writing region close event to WAL at 1676181781787 (+1 ms)Running coprocessor post-close hooks at 1676181781801 (+14 ms)Closed at 1676181781802 (+1 ms) 2023-02-12 06:03:01,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6. 2023-02-12 06:03:01,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c208c138f9bebfcad824fa3fbb7e912a, disabling compactions & flushes 2023-02-12 06:03:01,802 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a. 2023-02-12 06:03:01,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a. 2023-02-12 06:03:01,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a. after waiting 0 ms 2023-02-12 06:03:01,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a. 2023-02-12 06:03:01,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/c208c138f9bebfcad824fa3fbb7e912a/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 06:03:01,824 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a. 2023-02-12 06:03:01,825 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/hbase/namespace/70962f2f424e7a6feeef8d88d58ef25d/.tmp/info/866ae597368a4cc5bbdd129949a99c40 2023-02-12 06:03:01,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c208c138f9bebfcad824fa3fbb7e912a: Waiting for close lock at 1676181781802Running coprocessor pre-close hooks at 1676181781802Disabling compacts and flushes for region at 1676181781802Disabling writes for close at 1676181781802Writing region close event to WAL at 1676181781816 (+14 ms)Running coprocessor post-close hooks at 1676181781820 (+4 ms)Closed at 1676181781824 (+4 ms) 2023-02-12 06:03:01,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a. 2023-02-12 06:03:01,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1d974d28b432221ca9ffde441bf98fb2, disabling compactions & flushes 2023-02-12 06:03:01,825 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2. 2023-02-12 06:03:01,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2. 2023-02-12 06:03:01,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2. after waiting 0 ms 2023-02-12 06:03:01,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2. 2023-02-12 06:03:01,834 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.76 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/hbase/meta/1588230740/.tmp/info/0b1eb67cc6c94f169ebe444651388217 2023-02-12 06:03:01,836 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/hbase/namespace/70962f2f424e7a6feeef8d88d58ef25d/.tmp/info/866ae597368a4cc5bbdd129949a99c40 as hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/hbase/namespace/70962f2f424e7a6feeef8d88d58ef25d/info/866ae597368a4cc5bbdd129949a99c40 2023-02-12 06:03:01,837 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/1d974d28b432221ca9ffde441bf98fb2/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 06:03:01,839 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2. 2023-02-12 06:03:01,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1d974d28b432221ca9ffde441bf98fb2: Waiting for close lock at 1676181781825Running coprocessor pre-close hooks at 1676181781825Disabling compacts and flushes for region at 1676181781825Disabling writes for close at 1676181781825Writing region close event to WAL at 1676181781833 (+8 ms)Running coprocessor post-close hooks at 1676181781838 (+5 ms)Closed at 1676181781839 (+1 ms) 2023-02-12 06:03:01,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2. 2023-02-12 06:03:01,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ac4bbab435a2c040bbdb8338c993e6ec, disabling compactions & flushes 2023-02-12 06:03:01,839 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec. 2023-02-12 06:03:01,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec. 2023-02-12 06:03:01,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec. after waiting 0 ms 2023-02-12 06:03:01,839 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec. 2023-02-12 06:03:01,848 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/hbase/namespace/70962f2f424e7a6feeef8d88d58ef25d/info/866ae597368a4cc5bbdd129949a99c40, entries=2, sequenceid=6, filesize=4.8 K 2023-02-12 06:03:01,851 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 70962f2f424e7a6feeef8d88d58ef25d in 51ms, sequenceid=6, compaction requested=false 2023-02-12 06:03:01,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-12 06:03:01,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/ac4bbab435a2c040bbdb8338c993e6ec/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 06:03:01,858 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec. 2023-02-12 06:03:01,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ac4bbab435a2c040bbdb8338c993e6ec: Waiting for close lock at 1676181781839Running coprocessor pre-close hooks at 1676181781839Disabling compacts and flushes for region at 1676181781839Disabling writes for close at 1676181781839Writing region close event to WAL at 1676181781847 (+8 ms)Running coprocessor post-close hooks at 1676181781857 (+10 ms)Closed at 1676181781858 (+1 ms) 2023-02-12 06:03:01,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec. 2023-02-12 06:03:01,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing bc33ffcdfaec411e24236b6d44e5db2b, disabling compactions & flushes 2023-02-12 06:03:01,858 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b. 2023-02-12 06:03:01,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b. 2023-02-12 06:03:01,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b. after waiting 0 ms 2023-02-12 06:03:01,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b. 2023-02-12 06:03:01,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/hbase/namespace/70962f2f424e7a6feeef8d88d58ef25d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-12 06:03:01,867 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/hbase/meta/1588230740/.tmp/table/781c77c07d5243e482b91842c5a2c9b1 2023-02-12 06:03:01,867 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676181777873.70962f2f424e7a6feeef8d88d58ef25d. 2023-02-12 06:03:01,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 70962f2f424e7a6feeef8d88d58ef25d: Waiting for close lock at 1676181781800Running coprocessor pre-close hooks at 1676181781800Disabling compacts and flushes for region at 1676181781800Disabling writes for close at 1676181781800Obtaining lock to block concurrent updates at 1676181781800Preparing flush snapshotting stores in 70962f2f424e7a6feeef8d88d58ef25d at 1676181781800Finished memstore snapshotting hbase:namespace,,1676181777873.70962f2f424e7a6feeef8d88d58ef25d., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676181781800Flushing stores of hbase:namespace,,1676181777873.70962f2f424e7a6feeef8d88d58ef25d. at 1676181781802 (+2 ms)Flushing 70962f2f424e7a6feeef8d88d58ef25d/info: creating writer at 1676181781802Flushing 70962f2f424e7a6feeef8d88d58ef25d/info: appending metadata at 1676181781813 (+11 ms)Flushing 70962f2f424e7a6feeef8d88d58ef25d/info: closing flushed file at 1676181781813Flushing 70962f2f424e7a6feeef8d88d58ef25d/info: reopening flushed file at 1676181781836 (+23 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 70962f2f424e7a6feeef8d88d58ef25d in 51ms, sequenceid=6, compaction requested=false at 1676181781851 (+15 ms)Writing region close event to WAL at 1676181781856 (+5 ms)Running coprocessor post-close hooks at 1676181781864 (+8 ms)Closed at 1676181781867 (+3 ms) 2023-02-12 06:03:01,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676181777873.70962f2f424e7a6feeef8d88d58ef25d. 2023-02-12 06:03:01,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 96e1fed3c51e76d3db58034d221e5500, disabling compactions & flushes 2023-02-12 06:03:01,867 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500. 2023-02-12 06:03:01,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500. 2023-02-12 06:03:01,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500. after waiting 0 ms 2023-02-12 06:03:01,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500. 2023-02-12 06:03:01,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/bc33ffcdfaec411e24236b6d44e5db2b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 06:03:01,872 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b. 2023-02-12 06:03:01,872 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for bc33ffcdfaec411e24236b6d44e5db2b: Waiting for close lock at 1676181781858Running coprocessor pre-close hooks at 1676181781858Disabling compacts and flushes for region at 1676181781858Disabling writes for close at 1676181781858Writing region close event to WAL at 1676181781868 (+10 ms)Running coprocessor post-close hooks at 1676181781872 (+4 ms)Closed at 1676181781872 2023-02-12 06:03:01,872 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b. 2023-02-12 06:03:01,873 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/hbase/meta/1588230740/.tmp/info/0b1eb67cc6c94f169ebe444651388217 as hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/hbase/meta/1588230740/info/0b1eb67cc6c94f169ebe444651388217 2023-02-12 06:03:01,873 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/96e1fed3c51e76d3db58034d221e5500/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 06:03:01,876 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500. 2023-02-12 06:03:01,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 96e1fed3c51e76d3db58034d221e5500: Waiting for close lock at 1676181781867Running coprocessor pre-close hooks at 1676181781867Disabling compacts and flushes for region at 1676181781867Disabling writes for close at 1676181781867Writing region close event to WAL at 1676181781869 (+2 ms)Running coprocessor post-close hooks at 1676181781874 (+5 ms)Closed at 1676181781876 (+2 ms) 2023-02-12 06:03:01,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500. 2023-02-12 06:03:01,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0791c9d76ddc855936e4dac63b936fe3, disabling compactions & flushes 2023-02-12 06:03:01,876 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3. 2023-02-12 06:03:01,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3. 2023-02-12 06:03:01,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3. after waiting 0 ms 2023-02-12 06:03:01,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3. 2023-02-12 06:03:01,881 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/hbase/meta/1588230740/info/0b1eb67cc6c94f169ebe444651388217, entries=110, sequenceid=32, filesize=18.7 K 2023-02-12 06:03:01,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/0791c9d76ddc855936e4dac63b936fe3/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 06:03:01,881 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3. 2023-02-12 06:03:01,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0791c9d76ddc855936e4dac63b936fe3: Waiting for close lock at 1676181781876Running coprocessor pre-close hooks at 1676181781876Disabling compacts and flushes for region at 1676181781876Disabling writes for close at 1676181781876Writing region close event to WAL at 1676181781877 (+1 ms)Running coprocessor post-close hooks at 1676181781881 (+4 ms)Closed at 1676181781881 2023-02-12 06:03:01,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3. 2023-02-12 06:03:01,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ec61a0ee1596767b26f9746acbc2e507, disabling compactions & flushes 2023-02-12 06:03:01,882 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507. 2023-02-12 06:03:01,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507. 2023-02-12 06:03:01,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507. after waiting 0 ms 2023-02-12 06:03:01,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507. 2023-02-12 06:03:01,886 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/hbase/meta/1588230740/.tmp/table/781c77c07d5243e482b91842c5a2c9b1 as hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/hbase/meta/1588230740/table/781c77c07d5243e482b91842c5a2c9b1 2023-02-12 06:03:01,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/ec61a0ee1596767b26f9746acbc2e507/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-12 06:03:01,888 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507. 2023-02-12 06:03:01,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ec61a0ee1596767b26f9746acbc2e507: Waiting for close lock at 1676181781882Running coprocessor pre-close hooks at 1676181781882Disabling compacts and flushes for region at 1676181781882Disabling writes for close at 1676181781882Writing region close event to WAL at 1676181781882Running coprocessor post-close hooks at 1676181781888 (+6 ms)Closed at 1676181781888 2023-02-12 06:03:01,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507. 2023-02-12 06:03:01,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5196f1f5c7fff2336111d751c7d841e2, disabling compactions & flushes 2023-02-12 06:03:01,888 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2. 2023-02-12 06:03:01,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2. 2023-02-12 06:03:01,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2. after waiting 0 ms 2023-02-12 06:03:01,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2. 2023-02-12 06:03:01,891 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/hbase/meta/1588230740/table/781c77c07d5243e482b91842c5a2c9b1, entries=4, sequenceid=32, filesize=4.8 K 2023-02-12 06:03:01,892 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 100ms, sequenceid=32, compaction requested=false 2023-02-12 06:03:01,892 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-12 06:03:01,893 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/default/testWithMapReduce/5196f1f5c7fff2336111d751c7d841e2/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 06:03:01,894 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2. 2023-02-12 06:03:01,894 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5196f1f5c7fff2336111d751c7d841e2: Waiting for close lock at 1676181781888Running coprocessor pre-close hooks at 1676181781888Disabling compacts and flushes for region at 1676181781888Disabling writes for close at 1676181781888Writing region close event to WAL at 1676181781890 (+2 ms)Running coprocessor post-close hooks at 1676181781894 (+4 ms)Closed at 1676181781894 2023-02-12 06:03:01,894 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2. 2023-02-12 06:03:01,898 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-12 06:03:01,899 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 06:03:01,899 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 06:03:01,899 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676181781790Running coprocessor pre-close hooks at 1676181781790Disabling compacts and flushes for region at 1676181781790Disabling writes for close at 1676181781791 (+1 ms)Obtaining lock to block concurrent updates at 1676181781793 (+2 ms)Preparing flush snapshotting stores in 1588230740 at 1676181781793Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=14280, getHeapSize=23552, getOffHeapSize=0, getCellsCount=114 at 1676181781797 (+4 ms)Flushing stores of hbase:meta,,1.1588230740 at 1676181781800 (+3 ms)Flushing 1588230740/info: creating writer at 1676181781800Flushing 1588230740/info: appending metadata at 1676181781816 (+16 ms)Flushing 1588230740/info: closing flushed file at 1676181781816Flushing 1588230740/table: creating writer at 1676181781847 (+31 ms)Flushing 1588230740/table: appending metadata at 1676181781851 (+4 ms)Flushing 1588230740/table: closing flushed file at 1676181781851Flushing 1588230740/info: reopening flushed file at 1676181781873 (+22 ms)Flushing 1588230740/table: reopening flushed file at 1676181781887 (+14 ms)Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 100ms, sequenceid=32, compaction requested=false at 1676181781892 (+5 ms)Writing region close event to WAL at 1676181781896 (+4 ms)Running coprocessor post-close hooks at 1676181781899 (+3 ms)Closed at 1676181781899 2023-02-12 06:03:01,899 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-12 06:03:01,989 INFO [RS:0;jenkins-hbase4:42183] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42183,1676181777167; all regions closed. 2023-02-12 06:03:01,991 INFO [RS:1;jenkins-hbase4:37181] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,37181,1676181777204; all regions closed. 2023-02-12 06:03:01,997 DEBUG [RS:0;jenkins-hbase4:42183] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/oldWALs 2023-02-12 06:03:01,997 INFO [RS:0;jenkins-hbase4:42183] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42183%2C1676181777167:(num 1676181778255) 2023-02-12 06:03:01,997 DEBUG [RS:0;jenkins-hbase4:42183] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:01,997 INFO [RS:0;jenkins-hbase4:42183] regionserver.LeaseManager(133): Closed leases 2023-02-12 06:03:01,997 INFO [RS:0;jenkins-hbase4:42183] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-12 06:03:01,997 INFO [RS:0;jenkins-hbase4:42183] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 06:03:01,997 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 06:03:01,997 INFO [RS:0;jenkins-hbase4:42183] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 06:03:01,997 INFO [RS:0;jenkins-hbase4:42183] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 06:03:01,998 INFO [RS:0;jenkins-hbase4:42183] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42183 2023-02-12 06:03:02,002 DEBUG [RS:1;jenkins-hbase4:37181] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/oldWALs 2023-02-12 06:03:02,002 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): regionserver:37181-0x1004720144c0002, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:03:02,002 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 06:03:02,002 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): regionserver:42183-0x1004720144c0001, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42183,1676181777167 2023-02-12 06:03:02,003 ERROR [Listener at localhost/40063-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4b69542c rejected from java.util.concurrent.ThreadPoolExecutor@4f56d999[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:02,003 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): regionserver:42183-0x1004720144c0001, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 06:03:02,003 ERROR [Listener at localhost/40063-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3add9c4e rejected from java.util.concurrent.ThreadPoolExecutor@4f56d999[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:02,002 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): regionserver:37181-0x1004720144c0002, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 06:03:02,002 INFO [RS:1;jenkins-hbase4:37181] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37181%2C1676181777204.meta:.meta(num 1676181777803) 2023-02-12 06:03:02,007 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42183,1676181777167] 2023-02-12 06:03:02,007 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42183,1676181777167; numProcessing=1 2023-02-12 06:03:02,011 DEBUG [RS:1;jenkins-hbase4:37181] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/oldWALs 2023-02-12 06:03:02,011 INFO [RS:1;jenkins-hbase4:37181] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37181%2C1676181777204:(num 1676181778556) 2023-02-12 06:03:02,011 DEBUG [RS:1;jenkins-hbase4:37181] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:02,011 INFO [RS:1;jenkins-hbase4:37181] regionserver.LeaseManager(133): Closed leases 2023-02-12 06:03:02,011 INFO [RS:1;jenkins-hbase4:37181] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-12 06:03:02,011 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 06:03:02,012 INFO [RS:1;jenkins-hbase4:37181] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37181 2023-02-12 06:03:02,107 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): regionserver:42183-0x1004720144c0001, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:03:02,107 INFO [RS:0;jenkins-hbase4:42183] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42183,1676181777167; zookeeper connection closed. 2023-02-12 06:03:02,107 ERROR [Listener at localhost/40063-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4277ebe7 rejected from java.util.concurrent.ThreadPoolExecutor@4f56d999[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:02,108 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): regionserver:42183-0x1004720144c0001, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:03:02,108 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3a11c3b9] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3a11c3b9 2023-02-12 06:03:02,108 ERROR [Listener at localhost/40063-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3c126fb5 rejected from java.util.concurrent.ThreadPoolExecutor@4f56d999[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:02,109 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 06:03:02,109 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42183,1676181777167 already deleted, retry=false 2023-02-12 06:03:02,109 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): regionserver:37181-0x1004720144c0002, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37181,1676181777204 2023-02-12 06:03:02,109 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42183,1676181777167 expired; onlineServers=1 2023-02-12 06:03:02,109 ERROR [Listener at localhost/40063-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@71078feb rejected from java.util.concurrent.ThreadPoolExecutor@75381513[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:02,110 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37181,1676181777204] 2023-02-12 06:03:02,110 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37181,1676181777204; numProcessing=2 2023-02-12 06:03:02,111 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37181,1676181777204 already deleted, retry=false 2023-02-12 06:03:02,111 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37181,1676181777204 expired; onlineServers=0 2023-02-12 06:03:02,111 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45631,1676181777071' ***** 2023-02-12 06:03:02,111 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-12 06:03:02,113 DEBUG [M:0;jenkins-hbase4:45631] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@760302c2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 06:03:02,113 INFO [M:0;jenkins-hbase4:45631] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45631,1676181777071 2023-02-12 06:03:02,113 INFO [M:0;jenkins-hbase4:45631] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45631,1676181777071; all regions closed. 2023-02-12 06:03:02,113 DEBUG [M:0;jenkins-hbase4:45631] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:02,113 DEBUG [M:0;jenkins-hbase4:45631] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-12 06:03:02,113 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-12 06:03:02,113 DEBUG [M:0;jenkins-hbase4:45631] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-12 06:03:02,113 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676181777414] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676181777414,5,FailOnTimeoutGroup] 2023-02-12 06:03:02,113 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676181777414] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676181777414,5,FailOnTimeoutGroup] 2023-02-12 06:03:02,114 INFO [M:0;jenkins-hbase4:45631] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-12 06:03:02,115 INFO [M:0;jenkins-hbase4:45631] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-12 06:03:02,115 INFO [M:0;jenkins-hbase4:45631] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-12 06:03:02,115 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-12 06:03:02,115 DEBUG [M:0;jenkins-hbase4:45631] master.HMaster(1502): Stopping service threads 2023-02-12 06:03:02,115 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:02,115 INFO [M:0;jenkins-hbase4:45631] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-12 06:03:02,116 ERROR [M:0;jenkins-hbase4:45631] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-12 06:03:02,116 INFO [M:0;jenkins-hbase4:45631] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-12 06:03:02,116 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 06:03:02,116 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-12 06:03:02,116 DEBUG [M:0;jenkins-hbase4:45631] zookeeper.ZKUtil(398): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-12 06:03:02,117 WARN [M:0;jenkins-hbase4:45631] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-12 06:03:02,117 INFO [M:0;jenkins-hbase4:45631] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-12 06:03:02,117 INFO [M:0;jenkins-hbase4:45631] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-12 06:03:02,117 DEBUG [M:0;jenkins-hbase4:45631] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 06:03:02,117 INFO [M:0;jenkins-hbase4:45631] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:02,117 DEBUG [M:0;jenkins-hbase4:45631] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:02,117 DEBUG [M:0;jenkins-hbase4:45631] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 06:03:02,117 DEBUG [M:0;jenkins-hbase4:45631] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:02,117 INFO [M:0;jenkins-hbase4:45631] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=100.95 KB heapSize=120.63 KB 2023-02-12 06:03:02,127 INFO [M:0;jenkins-hbase4:45631] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=100.95 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7f0a6b9ee8d348c4a65b59551428230f 2023-02-12 06:03:02,132 DEBUG [M:0;jenkins-hbase4:45631] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7f0a6b9ee8d348c4a65b59551428230f as hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7f0a6b9ee8d348c4a65b59551428230f 2023-02-12 06:03:02,136 INFO [M:0;jenkins-hbase4:45631] regionserver.HStore(1080): Added hdfs://localhost:34365/user/jenkins/test-data/b57bc425-cbe5-4838-ebe9-3a33596a6acc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7f0a6b9ee8d348c4a65b59551428230f, entries=31, sequenceid=218, filesize=9.0 K 2023-02-12 06:03:02,137 INFO [M:0;jenkins-hbase4:45631] regionserver.HRegion(2947): Finished flush of dataSize ~100.95 KB/103374, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 20ms, sequenceid=218, compaction requested=false 2023-02-12 06:03:02,138 INFO [M:0;jenkins-hbase4:45631] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:02,138 DEBUG [M:0;jenkins-hbase4:45631] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676181782117Disabling compacts and flushes for region at 1676181782117Disabling writes for close at 1676181782117Obtaining lock to block concurrent updates at 1676181782117Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676181782117Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=103374, getHeapSize=123512, getOffHeapSize=0, getCellsCount=263 at 1676181782118 (+1 ms)Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676181782118Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676181782118Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676181782121 (+3 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676181782121Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676181782133 (+12 ms)Finished flush of dataSize ~100.95 KB/103374, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 20ms, sequenceid=218, compaction requested=false at 1676181782137 (+4 ms)Writing region close event to WAL at 1676181782138 (+1 ms)Closed at 1676181782138 2023-02-12 06:03:02,142 INFO [M:0;jenkins-hbase4:45631] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-12 06:03:02,142 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 06:03:02,143 INFO [M:0;jenkins-hbase4:45631] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45631 2023-02-12 06:03:02,146 DEBUG [M:0;jenkins-hbase4:45631] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,45631,1676181777071 already deleted, retry=false 2023-02-12 06:03:02,281 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:03:02,281 INFO [M:0;jenkins-hbase4:45631] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45631,1676181777071; zookeeper connection closed. 2023-02-12 06:03:02,282 ERROR [Listener at localhost/40063-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@35ead582 rejected from java.util.concurrent.ThreadPoolExecutor@31d557e7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:02,282 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): master:45631-0x1004720144c0000, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:03:02,283 ERROR [Listener at localhost/40063-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@26cc9c30 rejected from java.util.concurrent.ThreadPoolExecutor@31d557e7[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:02,382 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): regionserver:37181-0x1004720144c0002, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:03:02,382 INFO [RS:1;jenkins-hbase4:37181] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,37181,1676181777204; zookeeper connection closed. 2023-02-12 06:03:02,382 ERROR [Listener at localhost/40063-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4c75c6d2 rejected from java.util.concurrent.ThreadPoolExecutor@75381513[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:02,382 DEBUG [Listener at localhost/40063-EventThread] zookeeper.ZKWatcher(600): regionserver:37181-0x1004720144c0002, quorum=127.0.0.1:61935, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:03:02,382 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5c320997] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5c320997 2023-02-12 06:03:02,382 ERROR [Listener at localhost/40063-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@34656dc6 rejected from java.util.concurrent.ThreadPoolExecutor@75381513[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:02,382 INFO [Listener at localhost/40063] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-12 06:03:02,477 DEBUG [Listener at localhost/40063] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84/hadoop-3081635053987411339.jar 2023-02-12 06:03:02,481 INFO [Listener at localhost/40063] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676181779803 type: FLUSH version: 2 ttl: 0 2023-02-12 06:03:02,482 DEBUG [Listener at localhost/40063] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a/data/default/testWithMapReduce 2023-02-12 06:03:02,482 INFO [Listener at localhost/40063] snapshot.RestoreSnapshotHelper(239): region to add: 67a4fa90e2183d009f14b0952284dab6 2023-02-12 06:03:02,482 INFO [Listener at localhost/40063] snapshot.RestoreSnapshotHelper(239): region to add: c208c138f9bebfcad824fa3fbb7e912a 2023-02-12 06:03:02,483 INFO [Listener at localhost/40063] snapshot.RestoreSnapshotHelper(239): region to add: 1d974d28b432221ca9ffde441bf98fb2 2023-02-12 06:03:02,483 INFO [Listener at localhost/40063] snapshot.RestoreSnapshotHelper(239): region to add: 7db93b0592a0ffbad72426a53dea531d 2023-02-12 06:03:02,483 INFO [Listener at localhost/40063] snapshot.RestoreSnapshotHelper(239): region to add: bc33ffcdfaec411e24236b6d44e5db2b 2023-02-12 06:03:02,483 INFO [Listener at localhost/40063] snapshot.RestoreSnapshotHelper(239): region to add: ac4bbab435a2c040bbdb8338c993e6ec 2023-02-12 06:03:02,483 INFO [Listener at localhost/40063] snapshot.RestoreSnapshotHelper(239): region to add: 96e1fed3c51e76d3db58034d221e5500 2023-02-12 06:03:02,483 INFO [Listener at localhost/40063] snapshot.RestoreSnapshotHelper(239): region to add: 0791c9d76ddc855936e4dac63b936fe3 2023-02-12 06:03:02,483 INFO [Listener at localhost/40063] snapshot.RestoreSnapshotHelper(239): region to add: ec61a0ee1596767b26f9746acbc2e507 2023-02-12 06:03:02,483 INFO [Listener at localhost/40063] snapshot.RestoreSnapshotHelper(239): region to add: 5196f1f5c7fff2336111d751c7d841e2 2023-02-12 06:03:02,483 INFO [Listener at localhost/40063] snapshot.RestoreSnapshotHelper(585): clone region=67a4fa90e2183d009f14b0952284dab6 as 67a4fa90e2183d009f14b0952284dab6 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:02,484 INFO [Listener at localhost/40063] snapshot.RestoreSnapshotHelper(585): clone region=c208c138f9bebfcad824fa3fbb7e912a as c208c138f9bebfcad824fa3fbb7e912a in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:02,484 INFO [Listener at localhost/40063] snapshot.RestoreSnapshotHelper(585): clone region=1d974d28b432221ca9ffde441bf98fb2 as 1d974d28b432221ca9ffde441bf98fb2 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:02,484 INFO [Listener at localhost/40063] snapshot.RestoreSnapshotHelper(585): clone region=7db93b0592a0ffbad72426a53dea531d as 7db93b0592a0ffbad72426a53dea531d in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:02,484 INFO [Listener at localhost/40063] snapshot.RestoreSnapshotHelper(585): clone region=bc33ffcdfaec411e24236b6d44e5db2b as bc33ffcdfaec411e24236b6d44e5db2b in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:02,484 INFO [Listener at localhost/40063] snapshot.RestoreSnapshotHelper(585): clone region=ac4bbab435a2c040bbdb8338c993e6ec as ac4bbab435a2c040bbdb8338c993e6ec in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:02,484 INFO [Listener at localhost/40063] snapshot.RestoreSnapshotHelper(585): clone region=96e1fed3c51e76d3db58034d221e5500 as 96e1fed3c51e76d3db58034d221e5500 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:02,484 INFO [Listener at localhost/40063] snapshot.RestoreSnapshotHelper(585): clone region=0791c9d76ddc855936e4dac63b936fe3 as 0791c9d76ddc855936e4dac63b936fe3 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:02,484 INFO [Listener at localhost/40063] snapshot.RestoreSnapshotHelper(585): clone region=ec61a0ee1596767b26f9746acbc2e507 as ec61a0ee1596767b26f9746acbc2e507 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:02,484 INFO [Listener at localhost/40063] snapshot.RestoreSnapshotHelper(585): clone region=5196f1f5c7fff2336111d751c7d841e2 as 5196f1f5c7fff2336111d751c7d841e2 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-12 06:03:02,486 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 67a4fa90e2183d009f14b0952284dab6, NAME => 'testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a 2023-02-12 06:03:02,486 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 1d974d28b432221ca9ffde441bf98fb2, NAME => 'testWithMapReduce,j\xCA\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a 2023-02-12 06:03:02,486 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => c208c138f9bebfcad824fa3fbb7e912a, NAME => 'testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a 2023-02-12 06:03:02,489 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 7db93b0592a0ffbad72426a53dea531d, NAME => 'testWithMapReduce,m\xED\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a 2023-02-12 06:03:02,489 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => bc33ffcdfaec411e24236b6d44e5db2b, NAME => 'testWithMapReduce,q\x11\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a 2023-02-12 06:03:02,492 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => ac4bbab435a2c040bbdb8338c993e6ec, NAME => 'testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a 2023-02-12 06:03:02,493 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 0791c9d76ddc855936e4dac63b936fe3, NAME => 'testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a 2023-02-12 06:03:02,494 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 96e1fed3c51e76d3db58034d221e5500, NAME => 'testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a 2023-02-12 06:03:02,520 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:02,520 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 346c1005cc48497287a044bcb69147a2 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 06:03:02,522 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:02,522 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink fb69119bca724065a36924353665ca18 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 06:03:02,532 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:02,532 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:02,532 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a60b356808d34ee29a4eee52fc9fe1ac from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 06:03:02,532 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 46f91f292f89465e8f359699b9aef34d from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 06:03:02,540 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9490c477867c4eea8a2f126fe40ee0a9 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 06:03:02,541 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:02,541 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b3b5fb403ee6430c8ebba976cff2bc2c from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 06:03:02,541 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 054dfcfd9556487eb625b71080808f88 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 06:03:02,541 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 78e3aebfcce24e00843083da6afff755 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 06:03:02,546 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing ac4bbab435a2c040bbdb8338c993e6ec, disabling compactions & flushes 2023-02-12 06:03:02,546 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec. 2023-02-12 06:03:02,546 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec. 2023-02-12 06:03:02,546 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec. after waiting 0 ms 2023-02-12 06:03:02,546 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec. 2023-02-12 06:03:02,546 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec. 2023-02-12 06:03:02,546 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for ac4bbab435a2c040bbdb8338c993e6ec: Waiting for close lock at 1676181782546Disabling compacts and flushes for region at 1676181782546Disabling writes for close at 1676181782546Writing region close event to WAL at 1676181782546Closed at 1676181782546 2023-02-12 06:03:02,547 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => ec61a0ee1596767b26f9746acbc2e507, NAME => 'testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a 2023-02-12 06:03:02,552 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 35daa0f53c7c4e53b7e6238f646314b7 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 06:03:02,552 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:02,553 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9432de1e6014498e8e57d4785475ce5a from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 06:03:02,552 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:02,553 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 67a4fa90e2183d009f14b0952284dab6, disabling compactions & flushes 2023-02-12 06:03:02,553 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6. 2023-02-12 06:03:02,553 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6. 2023-02-12 06:03:02,553 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6. after waiting 0 ms 2023-02-12 06:03:02,553 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6. 2023-02-12 06:03:02,553 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6. 2023-02-12 06:03:02,553 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 67a4fa90e2183d009f14b0952284dab6: Waiting for close lock at 1676181782553Disabling compacts and flushes for region at 1676181782553Disabling writes for close at 1676181782553Writing region close event to WAL at 1676181782553Closed at 1676181782553 2023-02-12 06:03:02,553 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:02,554 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7e64eaebcd674fe6a6482b512c81ff9b from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 06:03:02,554 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5196f1f5c7fff2336111d751c7d841e2, NAME => 'testWithMapReduce,g\xA7\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a 2023-02-12 06:03:02,554 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 7db93b0592a0ffbad72426a53dea531d, disabling compactions & flushes 2023-02-12 06:03:02,554 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d. 2023-02-12 06:03:02,554 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d. 2023-02-12 06:03:02,554 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d. after waiting 0 ms 2023-02-12 06:03:02,554 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d. 2023-02-12 06:03:02,554 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d. 2023-02-12 06:03:02,555 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 7db93b0592a0ffbad72426a53dea531d: Waiting for close lock at 1676181782554Disabling compacts and flushes for region at 1676181782554Disabling writes for close at 1676181782554Writing region close event to WAL at 1676181782554Closed at 1676181782554 2023-02-12 06:03:02,555 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing bc33ffcdfaec411e24236b6d44e5db2b, disabling compactions & flushes 2023-02-12 06:03:02,555 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b. 2023-02-12 06:03:02,555 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b. 2023-02-12 06:03:02,555 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b. after waiting 0 ms 2023-02-12 06:03:02,555 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b. 2023-02-12 06:03:02,555 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b. 2023-02-12 06:03:02,555 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for bc33ffcdfaec411e24236b6d44e5db2b: Waiting for close lock at 1676181782555Disabling compacts and flushes for region at 1676181782555Disabling writes for close at 1676181782555Writing region close event to WAL at 1676181782555Closed at 1676181782555 2023-02-12 06:03:02,555 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c353a1a1500f4a819596bb5a29beca05 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 06:03:02,556 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 1d974d28b432221ca9ffde441bf98fb2, disabling compactions & flushes 2023-02-12 06:03:02,556 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2. 2023-02-12 06:03:02,556 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2. 2023-02-12 06:03:02,556 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2. after waiting 0 ms 2023-02-12 06:03:02,556 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2. 2023-02-12 06:03:02,556 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2. 2023-02-12 06:03:02,556 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 1d974d28b432221ca9ffde441bf98fb2: Waiting for close lock at 1676181782556Disabling compacts and flushes for region at 1676181782556Disabling writes for close at 1676181782556Writing region close event to WAL at 1676181782556Closed at 1676181782556 2023-02-12 06:03:02,560 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:02,560 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing ec61a0ee1596767b26f9746acbc2e507, disabling compactions & flushes 2023-02-12 06:03:02,560 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507. 2023-02-12 06:03:02,560 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507. 2023-02-12 06:03:02,560 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507. after waiting 0 ms 2023-02-12 06:03:02,560 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507. 2023-02-12 06:03:02,560 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507. 2023-02-12 06:03:02,560 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for ec61a0ee1596767b26f9746acbc2e507: Waiting for close lock at 1676181782560Disabling compacts and flushes for region at 1676181782560Disabling writes for close at 1676181782560Writing region close event to WAL at 1676181782560Closed at 1676181782560 2023-02-12 06:03:02,561 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink da6af60022d94b43a637ec3d4977845c from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 06:03:02,561 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 022a27c10d2c4b8097d36881aa483136 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 06:03:02,561 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 96e1fed3c51e76d3db58034d221e5500, disabling compactions & flushes 2023-02-12 06:03:02,561 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500. 2023-02-12 06:03:02,561 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500. 2023-02-12 06:03:02,561 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500. after waiting 0 ms 2023-02-12 06:03:02,561 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500. 2023-02-12 06:03:02,561 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500. 2023-02-12 06:03:02,561 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 96e1fed3c51e76d3db58034d221e5500: Waiting for close lock at 1676181782561Disabling compacts and flushes for region at 1676181782561Disabling writes for close at 1676181782561Writing region close event to WAL at 1676181782561Closed at 1676181782561 2023-02-12 06:03:02,565 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 0791c9d76ddc855936e4dac63b936fe3, disabling compactions & flushes 2023-02-12 06:03:02,565 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing c208c138f9bebfcad824fa3fbb7e912a, disabling compactions & flushes 2023-02-12 06:03:02,565 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3. 2023-02-12 06:03:02,565 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3. 2023-02-12 06:03:02,565 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3. after waiting 0 ms 2023-02-12 06:03:02,565 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3. 2023-02-12 06:03:02,565 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3. 2023-02-12 06:03:02,565 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a. 2023-02-12 06:03:02,565 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 0791c9d76ddc855936e4dac63b936fe3: Waiting for close lock at 1676181782565Disabling compacts and flushes for region at 1676181782565Disabling writes for close at 1676181782565Writing region close event to WAL at 1676181782565Closed at 1676181782565 2023-02-12 06:03:02,565 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a. 2023-02-12 06:03:02,565 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a. after waiting 0 ms 2023-02-12 06:03:02,565 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a. 2023-02-12 06:03:02,565 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a. 2023-02-12 06:03:02,565 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for c208c138f9bebfcad824fa3fbb7e912a: Waiting for close lock at 1676181782565Disabling compacts and flushes for region at 1676181782565Disabling writes for close at 1676181782565Writing region close event to WAL at 1676181782565Closed at 1676181782565 2023-02-12 06:03:02,567 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:02,567 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 523c602895504d239bc44b2ec918880f from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 06:03:02,570 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a49b419b0bc44a05b0b6acaa72650290 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-12 06:03:02,572 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 5196f1f5c7fff2336111d751c7d841e2, disabling compactions & flushes 2023-02-12 06:03:02,572 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2. 2023-02-12 06:03:02,572 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2. 2023-02-12 06:03:02,572 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2. after waiting 0 ms 2023-02-12 06:03:02,572 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2. 2023-02-12 06:03:02,572 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2. 2023-02-12 06:03:02,572 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 5196f1f5c7fff2336111d751c7d841e2: Waiting for close lock at 1676181782572Disabling compacts and flushes for region at 1676181782572Disabling writes for close at 1676181782572Writing region close event to WAL at 1676181782572Closed at 1676181782572 2023-02-12 06:03:02,572 INFO [Listener at localhost/40063] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676181779803 type: FLUSH version: 2 ttl: 0 2023-02-12 06:03:02,573 DEBUG [Listener at localhost/40063] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a 2023-02-12 06:03:02,573 DEBUG [Listener at localhost/40063] util.CommonFSUtils(682): File system contents for path hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a 2023-02-12 06:03:02,573 DEBUG [Listener at localhost/40063] util.CommonFSUtils(699): |-data/ 2023-02-12 06:03:02,574 DEBUG [Listener at localhost/40063] util.CommonFSUtils(699): |----default/ 2023-02-12 06:03:02,574 DEBUG [Listener at localhost/40063] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-12 06:03:02,575 DEBUG [Listener at localhost/40063] util.CommonFSUtils(699): |----------0791c9d76ddc855936e4dac63b936fe3/ 2023-02-12 06:03:02,576 DEBUG [Listener at localhost/40063] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 06:03:02,576 DEBUG [Listener at localhost/40063] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 06:03:02,576 DEBUG [Listener at localhost/40063] util.CommonFSUtils(702): |----------------testWithMapReduce=0791c9d76ddc855936e4dac63b936fe3-9432de1e6014498e8e57d4785475ce5a 2023-02-12 06:03:02,576 DEBUG [Listener at localhost/40063] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 06:03:02,577 DEBUG [Listener at localhost/40063] util.CommonFSUtils(702): |----------------testWithMapReduce=0791c9d76ddc855936e4dac63b936fe3-022a27c10d2c4b8097d36881aa483136 2023-02-12 06:03:02,577 DEBUG [Listener at localhost/40063] util.CommonFSUtils(699): |----------1d974d28b432221ca9ffde441bf98fb2/ 2023-02-12 06:03:02,577 DEBUG [Listener at localhost/40063] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 06:03:02,578 DEBUG [Listener at localhost/40063] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 06:03:02,578 DEBUG [Listener at localhost/40063] util.CommonFSUtils(702): |----------------testWithMapReduce=1d974d28b432221ca9ffde441bf98fb2-fb69119bca724065a36924353665ca18 2023-02-12 06:03:02,578 DEBUG [Listener at localhost/40063] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 06:03:02,579 DEBUG [Listener at localhost/40063] util.CommonFSUtils(702): |----------------testWithMapReduce=1d974d28b432221ca9ffde441bf98fb2-35daa0f53c7c4e53b7e6238f646314b7 2023-02-12 06:03:02,579 DEBUG [Listener at localhost/40063] util.CommonFSUtils(699): |----------5196f1f5c7fff2336111d751c7d841e2/ 2023-02-12 06:03:02,579 DEBUG [Listener at localhost/40063] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 06:03:02,580 DEBUG [Listener at localhost/40063] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 06:03:02,580 DEBUG [Listener at localhost/40063] util.CommonFSUtils(702): |----------------testWithMapReduce=5196f1f5c7fff2336111d751c7d841e2-523c602895504d239bc44b2ec918880f 2023-02-12 06:03:02,580 DEBUG [Listener at localhost/40063] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 06:03:02,581 DEBUG [Listener at localhost/40063] util.CommonFSUtils(702): |----------------testWithMapReduce=5196f1f5c7fff2336111d751c7d841e2-a49b419b0bc44a05b0b6acaa72650290 2023-02-12 06:03:02,581 DEBUG [Listener at localhost/40063] util.CommonFSUtils(699): |----------67a4fa90e2183d009f14b0952284dab6/ 2023-02-12 06:03:02,581 DEBUG [Listener at localhost/40063] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 06:03:02,581 DEBUG [Listener at localhost/40063] util.CommonFSUtils(699): |----------7db93b0592a0ffbad72426a53dea531d/ 2023-02-12 06:03:02,582 DEBUG [Listener at localhost/40063] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 06:03:02,582 DEBUG [Listener at localhost/40063] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 06:03:02,582 DEBUG [Listener at localhost/40063] util.CommonFSUtils(702): |----------------testWithMapReduce=7db93b0592a0ffbad72426a53dea531d-a60b356808d34ee29a4eee52fc9fe1ac 2023-02-12 06:03:02,582 DEBUG [Listener at localhost/40063] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 06:03:02,583 DEBUG [Listener at localhost/40063] util.CommonFSUtils(702): |----------------testWithMapReduce=7db93b0592a0ffbad72426a53dea531d-054dfcfd9556487eb625b71080808f88 2023-02-12 06:03:02,583 DEBUG [Listener at localhost/40063] util.CommonFSUtils(699): |----------96e1fed3c51e76d3db58034d221e5500/ 2023-02-12 06:03:02,583 DEBUG [Listener at localhost/40063] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 06:03:02,583 DEBUG [Listener at localhost/40063] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 06:03:02,584 DEBUG [Listener at localhost/40063] util.CommonFSUtils(702): |----------------testWithMapReduce=96e1fed3c51e76d3db58034d221e5500-78e3aebfcce24e00843083da6afff755 2023-02-12 06:03:02,584 DEBUG [Listener at localhost/40063] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 06:03:02,584 DEBUG [Listener at localhost/40063] util.CommonFSUtils(702): |----------------testWithMapReduce=96e1fed3c51e76d3db58034d221e5500-c353a1a1500f4a819596bb5a29beca05 2023-02-12 06:03:02,585 DEBUG [Listener at localhost/40063] util.CommonFSUtils(699): |----------ac4bbab435a2c040bbdb8338c993e6ec/ 2023-02-12 06:03:02,585 DEBUG [Listener at localhost/40063] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 06:03:02,585 DEBUG [Listener at localhost/40063] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 06:03:02,585 DEBUG [Listener at localhost/40063] util.CommonFSUtils(702): |----------------testWithMapReduce=ac4bbab435a2c040bbdb8338c993e6ec-346c1005cc48497287a044bcb69147a2 2023-02-12 06:03:02,585 DEBUG [Listener at localhost/40063] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 06:03:02,586 DEBUG [Listener at localhost/40063] util.CommonFSUtils(702): |----------------testWithMapReduce=ac4bbab435a2c040bbdb8338c993e6ec-9490c477867c4eea8a2f126fe40ee0a9 2023-02-12 06:03:02,586 DEBUG [Listener at localhost/40063] util.CommonFSUtils(699): |----------bc33ffcdfaec411e24236b6d44e5db2b/ 2023-02-12 06:03:02,586 DEBUG [Listener at localhost/40063] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 06:03:02,586 DEBUG [Listener at localhost/40063] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 06:03:02,587 DEBUG [Listener at localhost/40063] util.CommonFSUtils(702): |----------------testWithMapReduce=bc33ffcdfaec411e24236b6d44e5db2b-46f91f292f89465e8f359699b9aef34d 2023-02-12 06:03:02,587 DEBUG [Listener at localhost/40063] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 06:03:02,587 DEBUG [Listener at localhost/40063] util.CommonFSUtils(702): |----------------testWithMapReduce=bc33ffcdfaec411e24236b6d44e5db2b-b3b5fb403ee6430c8ebba976cff2bc2c 2023-02-12 06:03:02,587 DEBUG [Listener at localhost/40063] util.CommonFSUtils(699): |----------c208c138f9bebfcad824fa3fbb7e912a/ 2023-02-12 06:03:02,588 DEBUG [Listener at localhost/40063] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 06:03:02,588 DEBUG [Listener at localhost/40063] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 06:03:02,588 DEBUG [Listener at localhost/40063] util.CommonFSUtils(702): |----------------testWithMapReduce=c208c138f9bebfcad824fa3fbb7e912a-7e64eaebcd674fe6a6482b512c81ff9b 2023-02-12 06:03:02,588 DEBUG [Listener at localhost/40063] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 06:03:02,589 DEBUG [Listener at localhost/40063] util.CommonFSUtils(702): |----------------testWithMapReduce=c208c138f9bebfcad824fa3fbb7e912a-da6af60022d94b43a637ec3d4977845c 2023-02-12 06:03:02,589 DEBUG [Listener at localhost/40063] util.CommonFSUtils(699): |----------ec61a0ee1596767b26f9746acbc2e507/ 2023-02-12 06:03:02,589 DEBUG [Listener at localhost/40063] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 06:03:02,590 DEBUG [Listener at localhost/40063] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-12 06:03:02,590 DEBUG [Listener at localhost/40063] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-12 06:03:02,591 DEBUG [Listener at localhost/40063] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-12 06:03:02,591 DEBUG [Listener at localhost/40063] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-12 06:03:03,452 DEBUG [Listener at localhost/40063] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84/hadoop-6259428072171762193.jar 2023-02-12 06:03:03,452 DEBUG [Listener at localhost/40063] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-12 06:03:03,453 DEBUG [Listener at localhost/40063] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-12 06:03:03,518 DEBUG [Listener at localhost/40063] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84/hadoop-5727803042076017387.jar 2023-02-12 06:03:03,519 DEBUG [Listener at localhost/40063] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-12 06:03:03,519 DEBUG [Listener at localhost/40063] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-12 06:03:03,519 DEBUG [Listener at localhost/40063] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-12 06:03:03,520 DEBUG [Listener at localhost/40063] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-12 06:03:03,520 DEBUG [Listener at localhost/40063] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-12 06:03:03,521 DEBUG [Listener at localhost/40063] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-12 06:03:03,521 DEBUG [Listener at localhost/40063] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-12 06:03:03,521 DEBUG [Listener at localhost/40063] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-12 06:03:03,522 DEBUG [Listener at localhost/40063] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-12 06:03:03,522 DEBUG [Listener at localhost/40063] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-12 06:03:03,522 DEBUG [Listener at localhost/40063] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-12 06:03:03,523 DEBUG [Listener at localhost/40063] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-12 06:03:03,523 DEBUG [Listener at localhost/40063] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-12 06:03:03,524 DEBUG [Listener at localhost/40063] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-12 06:03:03,524 DEBUG [Listener at localhost/40063] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-12 06:03:03,524 DEBUG [Listener at localhost/40063] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-12 06:03:03,525 DEBUG [Listener at localhost/40063] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-12 06:03:03,525 DEBUG [Listener at localhost/40063] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 06:03:03,526 DEBUG [Listener at localhost/40063] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 06:03:03,526 DEBUG [Listener at localhost/40063] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 06:03:03,527 DEBUG [Listener at localhost/40063] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-12 06:03:03,592 DEBUG [Listener at localhost/40063] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84/hadoop-5587792880630185909.jar 2023-02-12 06:03:03,592 DEBUG [Listener at localhost/40063] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-12 06:03:03,598 WARN [Listener at localhost/40063] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-12 06:03:03,603 WARN [Listener at localhost/40063] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-12 06:03:03,610 INFO [Listener at localhost/40063] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-12 06:03:03,708 WARN [Listener at localhost/40063] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84/mapreduce.cluster.local.dir/1676181783677/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-12 06:03:03,708 WARN [Listener at localhost/40063] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84/mapreduce.cluster.local.dir/1676181783677/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-12 06:03:03,744 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:03,744 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 06:03:03,745 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:03:03,747 INFO [StoreOpener-0791c9d76ddc855936e4dac63b936fe3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0791c9d76ddc855936e4dac63b936fe3 2023-02-12 06:03:03,748 DEBUG [StoreOpener-0791c9d76ddc855936e4dac63b936fe3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a/data/default/testWithMapReduce/0791c9d76ddc855936e4dac63b936fe3/f1 2023-02-12 06:03:03,748 INFO [StoreOpener-0791c9d76ddc855936e4dac63b936fe3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0791c9d76ddc855936e4dac63b936fe3 columnFamilyName f1 2023-02-12 06:03:03,753 DEBUG [StoreOpener-0791c9d76ddc855936e4dac63b936fe3-1] regionserver.HStore(539): loaded hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a/data/default/testWithMapReduce/0791c9d76ddc855936e4dac63b936fe3/f1/testWithMapReduce=0791c9d76ddc855936e4dac63b936fe3-9432de1e6014498e8e57d4785475ce5a 2023-02-12 06:03:03,753 INFO [StoreOpener-0791c9d76ddc855936e4dac63b936fe3-1] regionserver.HStore(310): Store=0791c9d76ddc855936e4dac63b936fe3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:03,753 INFO [StoreOpener-0791c9d76ddc855936e4dac63b936fe3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0791c9d76ddc855936e4dac63b936fe3 2023-02-12 06:03:03,754 DEBUG [StoreOpener-0791c9d76ddc855936e4dac63b936fe3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a/data/default/testWithMapReduce/0791c9d76ddc855936e4dac63b936fe3/f2 2023-02-12 06:03:03,754 INFO [StoreOpener-0791c9d76ddc855936e4dac63b936fe3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0791c9d76ddc855936e4dac63b936fe3 columnFamilyName f2 2023-02-12 06:03:03,759 DEBUG [StoreOpener-0791c9d76ddc855936e4dac63b936fe3-1] regionserver.HStore(539): loaded hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a/data/default/testWithMapReduce/0791c9d76ddc855936e4dac63b936fe3/f2/testWithMapReduce=0791c9d76ddc855936e4dac63b936fe3-022a27c10d2c4b8097d36881aa483136 2023-02-12 06:03:03,759 INFO [StoreOpener-0791c9d76ddc855936e4dac63b936fe3-1] regionserver.HStore(310): Store=0791c9d76ddc855936e4dac63b936fe3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:03,760 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:03:03,760 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 0791c9d76ddc855936e4dac63b936fe3; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71217328, jitterRate=0.06122088432312012}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:03:03,760 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 0791c9d76ddc855936e4dac63b936fe3: Writing region info on filesystem at 1676181783745Initializing all the Stores at 1676181783746 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181783746Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181783746Region opened successfully at 1676181783760 (+14 ms) 2023-02-12 06:03:03,791 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 0791c9d76ddc855936e4dac63b936fe3, disabling compactions & flushes 2023-02-12 06:03:03,792 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3. 2023-02-12 06:03:03,792 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3. 2023-02-12 06:03:03,792 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3. after waiting 0 ms 2023-02-12 06:03:03,792 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3. 2023-02-12 06:03:03,793 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676181778448.0791c9d76ddc855936e4dac63b936fe3. 2023-02-12 06:03:03,793 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 0791c9d76ddc855936e4dac63b936fe3: Waiting for close lock at 1676181783791Disabling compacts and flushes for region at 1676181783791Disabling writes for close at 1676181783792 (+1 ms)Writing region close event to WAL at 1676181783793 (+1 ms)Closed at 1676181783793 2023-02-12 06:03:03,796 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:03,797 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 06:03:03,799 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:03:03,801 INFO [StoreOpener-7db93b0592a0ffbad72426a53dea531d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7db93b0592a0ffbad72426a53dea531d 2023-02-12 06:03:03,802 DEBUG [StoreOpener-7db93b0592a0ffbad72426a53dea531d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a/data/default/testWithMapReduce/7db93b0592a0ffbad72426a53dea531d/f1 2023-02-12 06:03:03,802 INFO [StoreOpener-7db93b0592a0ffbad72426a53dea531d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7db93b0592a0ffbad72426a53dea531d columnFamilyName f1 2023-02-12 06:03:03,807 DEBUG [StoreOpener-7db93b0592a0ffbad72426a53dea531d-1] regionserver.HStore(539): loaded hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a/data/default/testWithMapReduce/7db93b0592a0ffbad72426a53dea531d/f1/testWithMapReduce=7db93b0592a0ffbad72426a53dea531d-a60b356808d34ee29a4eee52fc9fe1ac 2023-02-12 06:03:03,807 INFO [StoreOpener-7db93b0592a0ffbad72426a53dea531d-1] regionserver.HStore(310): Store=7db93b0592a0ffbad72426a53dea531d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:03,807 INFO [StoreOpener-7db93b0592a0ffbad72426a53dea531d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7db93b0592a0ffbad72426a53dea531d 2023-02-12 06:03:03,808 DEBUG [StoreOpener-7db93b0592a0ffbad72426a53dea531d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a/data/default/testWithMapReduce/7db93b0592a0ffbad72426a53dea531d/f2 2023-02-12 06:03:03,808 INFO [StoreOpener-7db93b0592a0ffbad72426a53dea531d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7db93b0592a0ffbad72426a53dea531d columnFamilyName f2 2023-02-12 06:03:03,812 DEBUG [StoreOpener-7db93b0592a0ffbad72426a53dea531d-1] regionserver.HStore(539): loaded hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a/data/default/testWithMapReduce/7db93b0592a0ffbad72426a53dea531d/f2/testWithMapReduce=7db93b0592a0ffbad72426a53dea531d-054dfcfd9556487eb625b71080808f88 2023-02-12 06:03:03,812 INFO [StoreOpener-7db93b0592a0ffbad72426a53dea531d-1] regionserver.HStore(310): Store=7db93b0592a0ffbad72426a53dea531d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:03,813 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:03:03,813 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 7db93b0592a0ffbad72426a53dea531d; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65018680, jitterRate=-0.03114616870880127}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:03:03,813 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 7db93b0592a0ffbad72426a53dea531d: Writing region info on filesystem at 1676181783800Initializing all the Stores at 1676181783800Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181783800Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181783801 (+1 ms)Region opened successfully at 1676181783813 (+12 ms) 2023-02-12 06:03:03,842 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 7db93b0592a0ffbad72426a53dea531d, disabling compactions & flushes 2023-02-12 06:03:03,842 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d. 2023-02-12 06:03:03,842 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d. 2023-02-12 06:03:03,842 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d. after waiting 0 ms 2023-02-12 06:03:03,843 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d. 2023-02-12 06:03:03,844 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676181778448.7db93b0592a0ffbad72426a53dea531d. 2023-02-12 06:03:03,844 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 7db93b0592a0ffbad72426a53dea531d: Waiting for close lock at 1676181783842Disabling compacts and flushes for region at 1676181783842Disabling writes for close at 1676181783843 (+1 ms)Writing region close event to WAL at 1676181783844 (+1 ms)Closed at 1676181783844 2023-02-12 06:03:03,847 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:03,847 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 06:03:03,848 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:03:03,850 INFO [StoreOpener-67a4fa90e2183d009f14b0952284dab6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 67a4fa90e2183d009f14b0952284dab6 2023-02-12 06:03:03,851 DEBUG [StoreOpener-67a4fa90e2183d009f14b0952284dab6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a/data/default/testWithMapReduce/67a4fa90e2183d009f14b0952284dab6/f1 2023-02-12 06:03:03,851 INFO [StoreOpener-67a4fa90e2183d009f14b0952284dab6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 67a4fa90e2183d009f14b0952284dab6 columnFamilyName f1 2023-02-12 06:03:03,852 INFO [StoreOpener-67a4fa90e2183d009f14b0952284dab6-1] regionserver.HStore(310): Store=67a4fa90e2183d009f14b0952284dab6/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:03,852 INFO [StoreOpener-67a4fa90e2183d009f14b0952284dab6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 67a4fa90e2183d009f14b0952284dab6 2023-02-12 06:03:03,853 DEBUG [StoreOpener-67a4fa90e2183d009f14b0952284dab6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a/data/default/testWithMapReduce/67a4fa90e2183d009f14b0952284dab6/f2 2023-02-12 06:03:03,853 INFO [StoreOpener-67a4fa90e2183d009f14b0952284dab6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 67a4fa90e2183d009f14b0952284dab6 columnFamilyName f2 2023-02-12 06:03:03,854 INFO [StoreOpener-67a4fa90e2183d009f14b0952284dab6-1] regionserver.HStore(310): Store=67a4fa90e2183d009f14b0952284dab6/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:03,854 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:03:03,854 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 67a4fa90e2183d009f14b0952284dab6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58820198, jitterRate=-0.12351074814796448}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:03:03,854 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 67a4fa90e2183d009f14b0952284dab6: Writing region info on filesystem at 1676181783848Initializing all the Stores at 1676181783849 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181783849Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181783849Region opened successfully at 1676181783854 (+5 ms) 2023-02-12 06:03:03,882 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 67a4fa90e2183d009f14b0952284dab6, disabling compactions & flushes 2023-02-12 06:03:03,882 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6. 2023-02-12 06:03:03,882 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6. 2023-02-12 06:03:03,882 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6. after waiting 0 ms 2023-02-12 06:03:03,882 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6. 2023-02-12 06:03:03,882 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676181778448.67a4fa90e2183d009f14b0952284dab6. 2023-02-12 06:03:03,882 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 67a4fa90e2183d009f14b0952284dab6: Waiting for close lock at 1676181783882Disabling compacts and flushes for region at 1676181783882Disabling writes for close at 1676181783882Writing region close event to WAL at 1676181783882Closed at 1676181783882 2023-02-12 06:03:03,886 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:03,886 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 06:03:03,887 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:03:03,889 INFO [StoreOpener-bc33ffcdfaec411e24236b6d44e5db2b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bc33ffcdfaec411e24236b6d44e5db2b 2023-02-12 06:03:03,890 DEBUG [StoreOpener-bc33ffcdfaec411e24236b6d44e5db2b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a/data/default/testWithMapReduce/bc33ffcdfaec411e24236b6d44e5db2b/f1 2023-02-12 06:03:03,890 INFO [StoreOpener-bc33ffcdfaec411e24236b6d44e5db2b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bc33ffcdfaec411e24236b6d44e5db2b columnFamilyName f1 2023-02-12 06:03:03,896 DEBUG [StoreOpener-bc33ffcdfaec411e24236b6d44e5db2b-1] regionserver.HStore(539): loaded hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a/data/default/testWithMapReduce/bc33ffcdfaec411e24236b6d44e5db2b/f1/testWithMapReduce=bc33ffcdfaec411e24236b6d44e5db2b-46f91f292f89465e8f359699b9aef34d 2023-02-12 06:03:03,896 INFO [StoreOpener-bc33ffcdfaec411e24236b6d44e5db2b-1] regionserver.HStore(310): Store=bc33ffcdfaec411e24236b6d44e5db2b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:03,896 INFO [StoreOpener-bc33ffcdfaec411e24236b6d44e5db2b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bc33ffcdfaec411e24236b6d44e5db2b 2023-02-12 06:03:03,897 DEBUG [StoreOpener-bc33ffcdfaec411e24236b6d44e5db2b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a/data/default/testWithMapReduce/bc33ffcdfaec411e24236b6d44e5db2b/f2 2023-02-12 06:03:03,897 INFO [StoreOpener-bc33ffcdfaec411e24236b6d44e5db2b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bc33ffcdfaec411e24236b6d44e5db2b columnFamilyName f2 2023-02-12 06:03:03,901 DEBUG [StoreOpener-bc33ffcdfaec411e24236b6d44e5db2b-1] regionserver.HStore(539): loaded hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a/data/default/testWithMapReduce/bc33ffcdfaec411e24236b6d44e5db2b/f2/testWithMapReduce=bc33ffcdfaec411e24236b6d44e5db2b-b3b5fb403ee6430c8ebba976cff2bc2c 2023-02-12 06:03:03,901 INFO [StoreOpener-bc33ffcdfaec411e24236b6d44e5db2b-1] regionserver.HStore(310): Store=bc33ffcdfaec411e24236b6d44e5db2b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:03,901 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:03:03,902 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened bc33ffcdfaec411e24236b6d44e5db2b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68685711, jitterRate=0.023496851325035095}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:03:03,902 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for bc33ffcdfaec411e24236b6d44e5db2b: Writing region info on filesystem at 1676181783887Initializing all the Stores at 1676181783888 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181783888Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181783888Region opened successfully at 1676181783902 (+14 ms) 2023-02-12 06:03:03,933 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing bc33ffcdfaec411e24236b6d44e5db2b, disabling compactions & flushes 2023-02-12 06:03:03,933 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b. 2023-02-12 06:03:03,933 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b. 2023-02-12 06:03:03,933 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b. after waiting 0 ms 2023-02-12 06:03:03,933 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b. 2023-02-12 06:03:03,934 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676181778448.bc33ffcdfaec411e24236b6d44e5db2b. 2023-02-12 06:03:03,934 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for bc33ffcdfaec411e24236b6d44e5db2b: Waiting for close lock at 1676181783933Disabling compacts and flushes for region at 1676181783933Disabling writes for close at 1676181783933Writing region close event to WAL at 1676181783934 (+1 ms)Closed at 1676181783934 2023-02-12 06:03:03,938 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:03,938 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 06:03:03,940 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:03:03,942 INFO [StoreOpener-5196f1f5c7fff2336111d751c7d841e2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5196f1f5c7fff2336111d751c7d841e2 2023-02-12 06:03:03,943 DEBUG [StoreOpener-5196f1f5c7fff2336111d751c7d841e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a/data/default/testWithMapReduce/5196f1f5c7fff2336111d751c7d841e2/f1 2023-02-12 06:03:03,944 INFO [StoreOpener-5196f1f5c7fff2336111d751c7d841e2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5196f1f5c7fff2336111d751c7d841e2 columnFamilyName f1 2023-02-12 06:03:03,949 DEBUG [StoreOpener-5196f1f5c7fff2336111d751c7d841e2-1] regionserver.HStore(539): loaded hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a/data/default/testWithMapReduce/5196f1f5c7fff2336111d751c7d841e2/f1/testWithMapReduce=5196f1f5c7fff2336111d751c7d841e2-523c602895504d239bc44b2ec918880f 2023-02-12 06:03:03,949 INFO [StoreOpener-5196f1f5c7fff2336111d751c7d841e2-1] regionserver.HStore(310): Store=5196f1f5c7fff2336111d751c7d841e2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:03,950 INFO [StoreOpener-5196f1f5c7fff2336111d751c7d841e2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5196f1f5c7fff2336111d751c7d841e2 2023-02-12 06:03:03,950 DEBUG [StoreOpener-5196f1f5c7fff2336111d751c7d841e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a/data/default/testWithMapReduce/5196f1f5c7fff2336111d751c7d841e2/f2 2023-02-12 06:03:03,951 INFO [StoreOpener-5196f1f5c7fff2336111d751c7d841e2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5196f1f5c7fff2336111d751c7d841e2 columnFamilyName f2 2023-02-12 06:03:03,955 DEBUG [StoreOpener-5196f1f5c7fff2336111d751c7d841e2-1] regionserver.HStore(539): loaded hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a/data/default/testWithMapReduce/5196f1f5c7fff2336111d751c7d841e2/f2/testWithMapReduce=5196f1f5c7fff2336111d751c7d841e2-a49b419b0bc44a05b0b6acaa72650290 2023-02-12 06:03:03,956 INFO [StoreOpener-5196f1f5c7fff2336111d751c7d841e2-1] regionserver.HStore(310): Store=5196f1f5c7fff2336111d751c7d841e2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:03,956 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:03:03,956 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 5196f1f5c7fff2336111d751c7d841e2; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72625951, jitterRate=0.08221100270748138}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:03:03,956 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 5196f1f5c7fff2336111d751c7d841e2: Writing region info on filesystem at 1676181783940Initializing all the Stores at 1676181783941 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181783941Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181783941Region opened successfully at 1676181783956 (+15 ms) 2023-02-12 06:03:03,984 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 5196f1f5c7fff2336111d751c7d841e2, disabling compactions & flushes 2023-02-12 06:03:03,984 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2. 2023-02-12 06:03:03,984 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2. 2023-02-12 06:03:03,984 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2. after waiting 0 ms 2023-02-12 06:03:03,984 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2. 2023-02-12 06:03:03,985 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676181778448.5196f1f5c7fff2336111d751c7d841e2. 2023-02-12 06:03:03,985 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 5196f1f5c7fff2336111d751c7d841e2: Waiting for close lock at 1676181783983Disabling compacts and flushes for region at 1676181783983Disabling writes for close at 1676181783984 (+1 ms)Writing region close event to WAL at 1676181783985 (+1 ms)Closed at 1676181783985 2023-02-12 06:03:03,988 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:03,988 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 06:03:03,989 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:03:03,991 INFO [StoreOpener-ac4bbab435a2c040bbdb8338c993e6ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ac4bbab435a2c040bbdb8338c993e6ec 2023-02-12 06:03:03,992 DEBUG [StoreOpener-ac4bbab435a2c040bbdb8338c993e6ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a/data/default/testWithMapReduce/ac4bbab435a2c040bbdb8338c993e6ec/f1 2023-02-12 06:03:03,992 INFO [StoreOpener-ac4bbab435a2c040bbdb8338c993e6ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ac4bbab435a2c040bbdb8338c993e6ec columnFamilyName f1 2023-02-12 06:03:03,997 DEBUG [StoreOpener-ac4bbab435a2c040bbdb8338c993e6ec-1] regionserver.HStore(539): loaded hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a/data/default/testWithMapReduce/ac4bbab435a2c040bbdb8338c993e6ec/f1/testWithMapReduce=ac4bbab435a2c040bbdb8338c993e6ec-346c1005cc48497287a044bcb69147a2 2023-02-12 06:03:03,997 INFO [StoreOpener-ac4bbab435a2c040bbdb8338c993e6ec-1] regionserver.HStore(310): Store=ac4bbab435a2c040bbdb8338c993e6ec/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:03,997 INFO [StoreOpener-ac4bbab435a2c040bbdb8338c993e6ec-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ac4bbab435a2c040bbdb8338c993e6ec 2023-02-12 06:03:03,998 DEBUG [StoreOpener-ac4bbab435a2c040bbdb8338c993e6ec-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a/data/default/testWithMapReduce/ac4bbab435a2c040bbdb8338c993e6ec/f2 2023-02-12 06:03:03,998 INFO [StoreOpener-ac4bbab435a2c040bbdb8338c993e6ec-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ac4bbab435a2c040bbdb8338c993e6ec columnFamilyName f2 2023-02-12 06:03:04,001 DEBUG [StoreOpener-ac4bbab435a2c040bbdb8338c993e6ec-1] regionserver.HStore(539): loaded hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a/data/default/testWithMapReduce/ac4bbab435a2c040bbdb8338c993e6ec/f2/testWithMapReduce=ac4bbab435a2c040bbdb8338c993e6ec-9490c477867c4eea8a2f126fe40ee0a9 2023-02-12 06:03:04,002 INFO [StoreOpener-ac4bbab435a2c040bbdb8338c993e6ec-1] regionserver.HStore(310): Store=ac4bbab435a2c040bbdb8338c993e6ec/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:04,002 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:03:04,002 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened ac4bbab435a2c040bbdb8338c993e6ec; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72537253, jitterRate=0.08088929951190948}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:03:04,002 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for ac4bbab435a2c040bbdb8338c993e6ec: Writing region info on filesystem at 1676181783989Initializing all the Stores at 1676181783990 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181783990Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181783990Region opened successfully at 1676181784002 (+12 ms) 2023-02-12 06:03:04,032 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing ac4bbab435a2c040bbdb8338c993e6ec, disabling compactions & flushes 2023-02-12 06:03:04,032 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec. 2023-02-12 06:03:04,032 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec. 2023-02-12 06:03:04,032 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec. after waiting 0 ms 2023-02-12 06:03:04,032 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec. 2023-02-12 06:03:04,033 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676181778448.ac4bbab435a2c040bbdb8338c993e6ec. 2023-02-12 06:03:04,033 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for ac4bbab435a2c040bbdb8338c993e6ec: Waiting for close lock at 1676181784032Disabling compacts and flushes for region at 1676181784032Disabling writes for close at 1676181784032Writing region close event to WAL at 1676181784033 (+1 ms)Closed at 1676181784033 2023-02-12 06:03:04,036 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:04,036 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 06:03:04,037 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:03:04,038 INFO [StoreOpener-1d974d28b432221ca9ffde441bf98fb2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1d974d28b432221ca9ffde441bf98fb2 2023-02-12 06:03:04,039 DEBUG [StoreOpener-1d974d28b432221ca9ffde441bf98fb2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a/data/default/testWithMapReduce/1d974d28b432221ca9ffde441bf98fb2/f1 2023-02-12 06:03:04,039 INFO [StoreOpener-1d974d28b432221ca9ffde441bf98fb2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1d974d28b432221ca9ffde441bf98fb2 columnFamilyName f1 2023-02-12 06:03:04,043 DEBUG [StoreOpener-1d974d28b432221ca9ffde441bf98fb2-1] regionserver.HStore(539): loaded hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a/data/default/testWithMapReduce/1d974d28b432221ca9ffde441bf98fb2/f1/testWithMapReduce=1d974d28b432221ca9ffde441bf98fb2-fb69119bca724065a36924353665ca18 2023-02-12 06:03:04,044 INFO [StoreOpener-1d974d28b432221ca9ffde441bf98fb2-1] regionserver.HStore(310): Store=1d974d28b432221ca9ffde441bf98fb2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:04,044 INFO [StoreOpener-1d974d28b432221ca9ffde441bf98fb2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1d974d28b432221ca9ffde441bf98fb2 2023-02-12 06:03:04,044 DEBUG [StoreOpener-1d974d28b432221ca9ffde441bf98fb2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a/data/default/testWithMapReduce/1d974d28b432221ca9ffde441bf98fb2/f2 2023-02-12 06:03:04,045 INFO [StoreOpener-1d974d28b432221ca9ffde441bf98fb2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1d974d28b432221ca9ffde441bf98fb2 columnFamilyName f2 2023-02-12 06:03:04,049 DEBUG [StoreOpener-1d974d28b432221ca9ffde441bf98fb2-1] regionserver.HStore(539): loaded hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a/data/default/testWithMapReduce/1d974d28b432221ca9ffde441bf98fb2/f2/testWithMapReduce=1d974d28b432221ca9ffde441bf98fb2-35daa0f53c7c4e53b7e6238f646314b7 2023-02-12 06:03:04,049 INFO [StoreOpener-1d974d28b432221ca9ffde441bf98fb2-1] regionserver.HStore(310): Store=1d974d28b432221ca9ffde441bf98fb2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:04,049 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:03:04,049 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 1d974d28b432221ca9ffde441bf98fb2; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71238032, jitterRate=0.06152939796447754}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:03:04,049 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 1d974d28b432221ca9ffde441bf98fb2: Writing region info on filesystem at 1676181784037Initializing all the Stores at 1676181784038 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181784038Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181784038Region opened successfully at 1676181784049 (+11 ms) 2023-02-12 06:03:04,082 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 1d974d28b432221ca9ffde441bf98fb2, disabling compactions & flushes 2023-02-12 06:03:04,083 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2. 2023-02-12 06:03:04,083 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2. 2023-02-12 06:03:04,083 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2. after waiting 0 ms 2023-02-12 06:03:04,083 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2. 2023-02-12 06:03:04,083 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676181778448.1d974d28b432221ca9ffde441bf98fb2. 2023-02-12 06:03:04,083 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 1d974d28b432221ca9ffde441bf98fb2: Waiting for close lock at 1676181784082Disabling compacts and flushes for region at 1676181784082Disabling writes for close at 1676181784083 (+1 ms)Writing region close event to WAL at 1676181784083Closed at 1676181784083 2023-02-12 06:03:04,086 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:04,086 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 06:03:04,087 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:03:04,089 INFO [StoreOpener-96e1fed3c51e76d3db58034d221e5500-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 96e1fed3c51e76d3db58034d221e5500 2023-02-12 06:03:04,090 DEBUG [StoreOpener-96e1fed3c51e76d3db58034d221e5500-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a/data/default/testWithMapReduce/96e1fed3c51e76d3db58034d221e5500/f1 2023-02-12 06:03:04,090 INFO [StoreOpener-96e1fed3c51e76d3db58034d221e5500-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 96e1fed3c51e76d3db58034d221e5500 columnFamilyName f1 2023-02-12 06:03:04,094 DEBUG [StoreOpener-96e1fed3c51e76d3db58034d221e5500-1] regionserver.HStore(539): loaded hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a/data/default/testWithMapReduce/96e1fed3c51e76d3db58034d221e5500/f1/testWithMapReduce=96e1fed3c51e76d3db58034d221e5500-78e3aebfcce24e00843083da6afff755 2023-02-12 06:03:04,095 INFO [StoreOpener-96e1fed3c51e76d3db58034d221e5500-1] regionserver.HStore(310): Store=96e1fed3c51e76d3db58034d221e5500/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:04,095 INFO [StoreOpener-96e1fed3c51e76d3db58034d221e5500-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 96e1fed3c51e76d3db58034d221e5500 2023-02-12 06:03:04,095 DEBUG [StoreOpener-96e1fed3c51e76d3db58034d221e5500-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a/data/default/testWithMapReduce/96e1fed3c51e76d3db58034d221e5500/f2 2023-02-12 06:03:04,096 INFO [StoreOpener-96e1fed3c51e76d3db58034d221e5500-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 96e1fed3c51e76d3db58034d221e5500 columnFamilyName f2 2023-02-12 06:03:04,100 DEBUG [StoreOpener-96e1fed3c51e76d3db58034d221e5500-1] regionserver.HStore(539): loaded hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a/data/default/testWithMapReduce/96e1fed3c51e76d3db58034d221e5500/f2/testWithMapReduce=96e1fed3c51e76d3db58034d221e5500-c353a1a1500f4a819596bb5a29beca05 2023-02-12 06:03:04,100 INFO [StoreOpener-96e1fed3c51e76d3db58034d221e5500-1] regionserver.HStore(310): Store=96e1fed3c51e76d3db58034d221e5500/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:04,100 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:03:04,100 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 96e1fed3c51e76d3db58034d221e5500; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59728634, jitterRate=-0.10997399687767029}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:03:04,100 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 96e1fed3c51e76d3db58034d221e5500: Writing region info on filesystem at 1676181784087Initializing all the Stores at 1676181784088 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181784088Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181784088Region opened successfully at 1676181784100 (+12 ms) 2023-02-12 06:03:04,134 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 96e1fed3c51e76d3db58034d221e5500, disabling compactions & flushes 2023-02-12 06:03:04,134 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500. 2023-02-12 06:03:04,134 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500. 2023-02-12 06:03:04,134 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500. after waiting 0 ms 2023-02-12 06:03:04,134 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500. 2023-02-12 06:03:04,136 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676181778448.96e1fed3c51e76d3db58034d221e5500. 2023-02-12 06:03:04,137 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 96e1fed3c51e76d3db58034d221e5500: Waiting for close lock at 1676181784134Disabling compacts and flushes for region at 1676181784134Disabling writes for close at 1676181784134Writing region close event to WAL at 1676181784136 (+2 ms)Closed at 1676181784136 2023-02-12 06:03:04,162 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:04,163 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 06:03:04,164 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:03:04,166 INFO [StoreOpener-c208c138f9bebfcad824fa3fbb7e912a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c208c138f9bebfcad824fa3fbb7e912a 2023-02-12 06:03:04,167 DEBUG [StoreOpener-c208c138f9bebfcad824fa3fbb7e912a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a/data/default/testWithMapReduce/c208c138f9bebfcad824fa3fbb7e912a/f1 2023-02-12 06:03:04,168 INFO [StoreOpener-c208c138f9bebfcad824fa3fbb7e912a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c208c138f9bebfcad824fa3fbb7e912a columnFamilyName f1 2023-02-12 06:03:04,174 DEBUG [StoreOpener-c208c138f9bebfcad824fa3fbb7e912a-1] regionserver.HStore(539): loaded hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a/data/default/testWithMapReduce/c208c138f9bebfcad824fa3fbb7e912a/f1/testWithMapReduce=c208c138f9bebfcad824fa3fbb7e912a-7e64eaebcd674fe6a6482b512c81ff9b 2023-02-12 06:03:04,174 INFO [StoreOpener-c208c138f9bebfcad824fa3fbb7e912a-1] regionserver.HStore(310): Store=c208c138f9bebfcad824fa3fbb7e912a/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:04,174 INFO [StoreOpener-c208c138f9bebfcad824fa3fbb7e912a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c208c138f9bebfcad824fa3fbb7e912a 2023-02-12 06:03:04,175 DEBUG [StoreOpener-c208c138f9bebfcad824fa3fbb7e912a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a/data/default/testWithMapReduce/c208c138f9bebfcad824fa3fbb7e912a/f2 2023-02-12 06:03:04,176 INFO [StoreOpener-c208c138f9bebfcad824fa3fbb7e912a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c208c138f9bebfcad824fa3fbb7e912a columnFamilyName f2 2023-02-12 06:03:04,181 DEBUG [StoreOpener-c208c138f9bebfcad824fa3fbb7e912a-1] regionserver.HStore(539): loaded hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a/data/default/testWithMapReduce/c208c138f9bebfcad824fa3fbb7e912a/f2/testWithMapReduce=c208c138f9bebfcad824fa3fbb7e912a-da6af60022d94b43a637ec3d4977845c 2023-02-12 06:03:04,181 INFO [StoreOpener-c208c138f9bebfcad824fa3fbb7e912a-1] regionserver.HStore(310): Store=c208c138f9bebfcad824fa3fbb7e912a/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:04,181 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:03:04,181 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened c208c138f9bebfcad824fa3fbb7e912a; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60604041, jitterRate=-0.09692941606044769}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:03:04,181 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for c208c138f9bebfcad824fa3fbb7e912a: Writing region info on filesystem at 1676181784164Initializing all the Stores at 1676181784165 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181784165Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181784166 (+1 ms)Region opened successfully at 1676181784181 (+15 ms) 2023-02-12 06:03:04,210 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing c208c138f9bebfcad824fa3fbb7e912a, disabling compactions & flushes 2023-02-12 06:03:04,211 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a. 2023-02-12 06:03:04,211 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a. 2023-02-12 06:03:04,211 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a. after waiting 0 ms 2023-02-12 06:03:04,211 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a. 2023-02-12 06:03:04,211 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676181778448.c208c138f9bebfcad824fa3fbb7e912a. 2023-02-12 06:03:04,212 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for c208c138f9bebfcad824fa3fbb7e912a: Waiting for close lock at 1676181784210Disabling compacts and flushes for region at 1676181784210Disabling writes for close at 1676181784211 (+1 ms)Writing region close event to WAL at 1676181784211Closed at 1676181784211 2023-02-12 06:03:04,214 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:04,214 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 06:03:04,216 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:03:04,218 INFO [StoreOpener-ec61a0ee1596767b26f9746acbc2e507-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ec61a0ee1596767b26f9746acbc2e507 2023-02-12 06:03:04,220 DEBUG [StoreOpener-ec61a0ee1596767b26f9746acbc2e507-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a/data/default/testWithMapReduce/ec61a0ee1596767b26f9746acbc2e507/f1 2023-02-12 06:03:04,220 INFO [StoreOpener-ec61a0ee1596767b26f9746acbc2e507-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec61a0ee1596767b26f9746acbc2e507 columnFamilyName f1 2023-02-12 06:03:04,221 INFO [StoreOpener-ec61a0ee1596767b26f9746acbc2e507-1] regionserver.HStore(310): Store=ec61a0ee1596767b26f9746acbc2e507/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:04,221 INFO [StoreOpener-ec61a0ee1596767b26f9746acbc2e507-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ec61a0ee1596767b26f9746acbc2e507 2023-02-12 06:03:04,222 DEBUG [StoreOpener-ec61a0ee1596767b26f9746acbc2e507-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34365/user/jenkins/test-data/f988ff8c-b6c1-2c5d-6bea-d96e7e69dd80/testWithMapReduceAndOfflineHBaseMultiRegion/7eb5cb16-4cc3-4842-bcbe-892ddce1ba5a/data/default/testWithMapReduce/ec61a0ee1596767b26f9746acbc2e507/f2 2023-02-12 06:03:04,222 INFO [StoreOpener-ec61a0ee1596767b26f9746acbc2e507-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec61a0ee1596767b26f9746acbc2e507 columnFamilyName f2 2023-02-12 06:03:04,223 INFO [StoreOpener-ec61a0ee1596767b26f9746acbc2e507-1] regionserver.HStore(310): Store=ec61a0ee1596767b26f9746acbc2e507/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:04,223 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:03:04,223 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened ec61a0ee1596767b26f9746acbc2e507; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59745769, jitterRate=-0.10971866548061371}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:03:04,223 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for ec61a0ee1596767b26f9746acbc2e507: Writing region info on filesystem at 1676181784216Initializing all the Stores at 1676181784217 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181784217Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181784217Region opened successfully at 1676181784223 (+6 ms) 2023-02-12 06:03:04,242 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing ec61a0ee1596767b26f9746acbc2e507, disabling compactions & flushes 2023-02-12 06:03:04,242 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507. 2023-02-12 06:03:04,242 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507. 2023-02-12 06:03:04,242 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507. after waiting 0 ms 2023-02-12 06:03:04,242 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507. 2023-02-12 06:03:04,242 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676181778448.ec61a0ee1596767b26f9746acbc2e507. 2023-02-12 06:03:04,242 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for ec61a0ee1596767b26f9746acbc2e507: Waiting for close lock at 1676181784242Disabling compacts and flushes for region at 1676181784242Disabling writes for close at 1676181784242Writing region close event to WAL at 1676181784242Closed at 1676181784242 2023-02-12 06:03:04,746 INFO [Listener at localhost/40063] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-12 06:03:04,746 WARN [Listener at localhost/40063] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 06:03:04,749 INFO [Listener at localhost/40063] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 06:03:04,824 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-12 06:03:04,870 WARN [BP-1139366116-172.31.14.131-1676181776263 heartbeating to localhost/127.0.0.1:34365] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 06:03:04,871 WARN [BP-1139366116-172.31.14.131-1676181776263 heartbeating to localhost/127.0.0.1:34365] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1139366116-172.31.14.131-1676181776263 (Datanode Uuid 30b17fb1-c4a5-4113-a0aa-16f5e97f599d) service to localhost/127.0.0.1:34365 2023-02-12 06:03:04,872 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84/cluster_ee3ede3e-352c-b98c-5116-0a645cdf8bab/dfs/data/data3/current/BP-1139366116-172.31.14.131-1676181776263] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 06:03:04,872 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84/cluster_ee3ede3e-352c-b98c-5116-0a645cdf8bab/dfs/data/data4/current/BP-1139366116-172.31.14.131-1676181776263] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 06:03:04,873 WARN [Listener at localhost/40063] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 06:03:04,880 INFO [Listener at localhost/40063] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 06:03:04,983 WARN [BP-1139366116-172.31.14.131-1676181776263 heartbeating to localhost/127.0.0.1:34365] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 06:03:04,985 WARN [BP-1139366116-172.31.14.131-1676181776263 heartbeating to localhost/127.0.0.1:34365] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1139366116-172.31.14.131-1676181776263 (Datanode Uuid 78a26fd7-c9e0-4f8a-8b17-c5f3dc565f54) service to localhost/127.0.0.1:34365 2023-02-12 06:03:04,986 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84/cluster_ee3ede3e-352c-b98c-5116-0a645cdf8bab/dfs/data/data1/current/BP-1139366116-172.31.14.131-1676181776263] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 06:03:04,986 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84/cluster_ee3ede3e-352c-b98c-5116-0a645cdf8bab/dfs/data/data2/current/BP-1139366116-172.31.14.131-1676181776263] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 06:03:04,995 INFO [Listener at localhost/40063] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 06:03:05,115 INFO [Listener at localhost/40063] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-12 06:03:05,161 INFO [Listener at localhost/40063] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-12 06:03:05,174 INFO [Listener at localhost/40063] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=158 (was 104) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost:34365 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:34365 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: (jenkins-hbase4.apache.org,45631,1676181777071)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:34365 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/40063 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:34365 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:34365 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:34365 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost:34365 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=545 (was 543) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=323 (was 337), ProcessCount=166 (was 166), AvailableMemoryMB=4354 (was 4558) 2023-02-12 06:03:05,183 INFO [Listener at localhost/40063] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=158, OpenFileDescriptor=545, MaxFileDescriptor=60000, SystemLoadAverage=323, ProcessCount=166, AvailableMemoryMB=4354 2023-02-12 06:03:05,194 INFO [Listener at localhost/40063] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84/hadoop.log.dir so I do NOT create it in target/test-data/906c6c76-a3b0-b323-5f50-4be63b60505e 2023-02-12 06:03:05,194 WARN [Listener at localhost/40063] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84/hadoop.log.dir Erasing configuration value by system value. 2023-02-12 06:03:05,194 INFO [Listener at localhost/40063] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84/hadoop.tmp.dir so I do NOT create it in target/test-data/906c6c76-a3b0-b323-5f50-4be63b60505e 2023-02-12 06:03:05,194 WARN [Listener at localhost/40063] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d5f98083-25d5-052a-5bfc-ca048edb0f84/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-12 06:03:05,194 DEBUG [Listener at localhost/40063] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/906c6c76-a3b0-b323-5f50-4be63b60505e 2023-02-12 06:03:05,195 INFO [Listener at localhost/40063] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-12 06:03:05,195 INFO [Listener at localhost/40063] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/906c6c76-a3b0-b323-5f50-4be63b60505e/cluster_a58b861a-c9d3-0aa4-9566-754a9193b49c, deleteOnExit=true 2023-02-12 06:03:05,195 INFO [Listener at localhost/40063] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-12 06:03:05,195 INFO [Listener at localhost/40063] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/906c6c76-a3b0-b323-5f50-4be63b60505e/test.cache.data in system properties and HBase conf 2023-02-12 06:03:05,195 INFO [Listener at localhost/40063] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/906c6c76-a3b0-b323-5f50-4be63b60505e/hadoop.tmp.dir in system properties and HBase conf 2023-02-12 06:03:05,195 INFO [Listener at localhost/40063] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/906c6c76-a3b0-b323-5f50-4be63b60505e/hadoop.log.dir in system properties and HBase conf 2023-02-12 06:03:05,195 INFO [Listener at localhost/40063] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/906c6c76-a3b0-b323-5f50-4be63b60505e/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-12 06:03:05,195 INFO [Listener at localhost/40063] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/906c6c76-a3b0-b323-5f50-4be63b60505e/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-12 06:03:05,195 INFO [Listener at localhost/40063] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-12 06:03:05,195 DEBUG [Listener at localhost/40063] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-12 06:03:05,196 INFO [Listener at localhost/40063] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/906c6c76-a3b0-b323-5f50-4be63b60505e/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-12 06:03:05,196 INFO [Listener at localhost/40063] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/906c6c76-a3b0-b323-5f50-4be63b60505e/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-12 06:03:05,196 INFO [Listener at localhost/40063] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/906c6c76-a3b0-b323-5f50-4be63b60505e/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-12 06:03:05,196 INFO [Listener at localhost/40063] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/906c6c76-a3b0-b323-5f50-4be63b60505e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 06:03:05,196 INFO [Listener at localhost/40063] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/906c6c76-a3b0-b323-5f50-4be63b60505e/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-12 06:03:05,196 INFO [Listener at localhost/40063] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/906c6c76-a3b0-b323-5f50-4be63b60505e/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-12 06:03:05,196 INFO [Listener at localhost/40063] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/906c6c76-a3b0-b323-5f50-4be63b60505e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 06:03:05,196 INFO [Listener at localhost/40063] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/906c6c76-a3b0-b323-5f50-4be63b60505e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 06:03:05,196 INFO [Listener at localhost/40063] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/906c6c76-a3b0-b323-5f50-4be63b60505e/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-12 06:03:05,197 INFO [Listener at localhost/40063] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/906c6c76-a3b0-b323-5f50-4be63b60505e/nfs.dump.dir in system properties and HBase conf 2023-02-12 06:03:05,197 INFO [Listener at localhost/40063] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/906c6c76-a3b0-b323-5f50-4be63b60505e/java.io.tmpdir in system properties and HBase conf 2023-02-12 06:03:05,197 INFO [Listener at localhost/40063] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/906c6c76-a3b0-b323-5f50-4be63b60505e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 06:03:05,197 INFO [Listener at localhost/40063] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/906c6c76-a3b0-b323-5f50-4be63b60505e/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-12 06:03:05,197 INFO [Listener at localhost/40063] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/906c6c76-a3b0-b323-5f50-4be63b60505e/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-12 06:03:05,209 WARN [Listener at localhost/40063] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 06:03:05,210 WARN [Listener at localhost/40063] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 06:03:05,253 WARN [Listener at localhost/40063] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 06:03:05,255 INFO [Listener at localhost/40063] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 06:03:05,264 INFO [Listener at localhost/40063] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/906c6c76-a3b0-b323-5f50-4be63b60505e/java.io.tmpdir/Jetty_localhost_45693_hdfs____.swx4mf/webapp 2023-02-12 06:03:05,356 INFO [Listener at localhost/40063] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45693 2023-02-12 06:03:05,361 WARN [Listener at localhost/40063] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 06:03:05,361 WARN [Listener at localhost/40063] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 06:03:06,028 WARN [Listener at localhost/36613] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 06:03:06,041 WARN [Listener at localhost/36613] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 06:03:06,043 WARN [Listener at localhost/36613] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 06:03:06,044 INFO [Listener at localhost/36613] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 06:03:06,050 INFO [Listener at localhost/36613] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/906c6c76-a3b0-b323-5f50-4be63b60505e/java.io.tmpdir/Jetty_localhost_42187_datanode____.8mzhbb/webapp 2023-02-12 06:03:06,142 INFO [Listener at localhost/36613] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42187 2023-02-12 06:03:06,149 WARN [Listener at localhost/44563] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 06:03:06,163 WARN [Listener at localhost/44563] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 06:03:06,166 WARN [Listener at localhost/44563] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 06:03:06,167 INFO [Listener at localhost/44563] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 06:03:06,171 INFO [Listener at localhost/44563] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/906c6c76-a3b0-b323-5f50-4be63b60505e/java.io.tmpdir/Jetty_localhost_43625_datanode____pdyrr5/webapp 2023-02-12 06:03:06,272 INFO [Listener at localhost/44563] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43625 2023-02-12 06:03:06,279 WARN [Listener at localhost/33723] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 06:03:06,385 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9e1bf4f6d5dbb92: Processing first storage report for DS-0cbfb90a-d959-4176-b114-a170c3458ad0 from datanode e1d66959-5163-4f76-bad8-9473ca8739ad 2023-02-12 06:03:06,385 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9e1bf4f6d5dbb92: from storage DS-0cbfb90a-d959-4176-b114-a170c3458ad0 node DatanodeRegistration(127.0.0.1:39301, datanodeUuid=e1d66959-5163-4f76-bad8-9473ca8739ad, infoPort=40247, infoSecurePort=0, ipcPort=44563, storageInfo=lv=-57;cid=testClusterID;nsid=1012887243;c=1676181785212), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 06:03:06,385 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9e1bf4f6d5dbb92: Processing first storage report for DS-b766ba38-0c69-4c43-8e62-1c737431dff1 from datanode e1d66959-5163-4f76-bad8-9473ca8739ad 2023-02-12 06:03:06,385 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9e1bf4f6d5dbb92: from storage DS-b766ba38-0c69-4c43-8e62-1c737431dff1 node DatanodeRegistration(127.0.0.1:39301, datanodeUuid=e1d66959-5163-4f76-bad8-9473ca8739ad, infoPort=40247, infoSecurePort=0, ipcPort=44563, storageInfo=lv=-57;cid=testClusterID;nsid=1012887243;c=1676181785212), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 06:03:06,582 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x321a646f283e7b87: Processing first storage report for DS-29dafe85-6d60-401c-8fd3-2e5ebb3cfff7 from datanode 91bd3116-13ef-4969-8035-ebadf996b88a 2023-02-12 06:03:06,583 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x321a646f283e7b87: from storage DS-29dafe85-6d60-401c-8fd3-2e5ebb3cfff7 node DatanodeRegistration(127.0.0.1:41943, datanodeUuid=91bd3116-13ef-4969-8035-ebadf996b88a, infoPort=38795, infoSecurePort=0, ipcPort=33723, storageInfo=lv=-57;cid=testClusterID;nsid=1012887243;c=1676181785212), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 06:03:06,583 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x321a646f283e7b87: Processing first storage report for DS-38617b0e-99b0-4873-946b-7c2ad90afc4a from datanode 91bd3116-13ef-4969-8035-ebadf996b88a 2023-02-12 06:03:06,583 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x321a646f283e7b87: from storage DS-38617b0e-99b0-4873-946b-7c2ad90afc4a node DatanodeRegistration(127.0.0.1:41943, datanodeUuid=91bd3116-13ef-4969-8035-ebadf996b88a, infoPort=38795, infoSecurePort=0, ipcPort=33723, storageInfo=lv=-57;cid=testClusterID;nsid=1012887243;c=1676181785212), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 06:03:06,588 DEBUG [Listener at localhost/33723] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/906c6c76-a3b0-b323-5f50-4be63b60505e 2023-02-12 06:03:06,590 INFO [Listener at localhost/33723] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/906c6c76-a3b0-b323-5f50-4be63b60505e/cluster_a58b861a-c9d3-0aa4-9566-754a9193b49c/zookeeper_0, clientPort=55171, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/906c6c76-a3b0-b323-5f50-4be63b60505e/cluster_a58b861a-c9d3-0aa4-9566-754a9193b49c/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/906c6c76-a3b0-b323-5f50-4be63b60505e/cluster_a58b861a-c9d3-0aa4-9566-754a9193b49c/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-12 06:03:06,591 INFO [Listener at localhost/33723] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=55171 2023-02-12 06:03:06,591 INFO [Listener at localhost/33723] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:06,592 INFO [Listener at localhost/33723] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:06,604 INFO [Listener at localhost/33723] util.FSUtils(479): Created version file at hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6 with version=8 2023-02-12 06:03:06,605 INFO [Listener at localhost/33723] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:06,605 INFO [Listener at localhost/33723] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:06,606 INFO [Listener at localhost/33723] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36613/user/jenkins/test-data/630b93c3-55d6-9f06-fe4e-f4dea26977f0/hbase-staging 2023-02-12 06:03:06,608 INFO [Listener at localhost/33723] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 06:03:06,608 INFO [Listener at localhost/33723] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:06,608 INFO [Listener at localhost/33723] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:06,608 INFO [Listener at localhost/33723] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 06:03:06,608 INFO [Listener at localhost/33723] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:06,608 INFO [Listener at localhost/33723] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 06:03:06,608 INFO [Listener at localhost/33723] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 06:03:06,610 INFO [Listener at localhost/33723] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42497 2023-02-12 06:03:06,610 INFO [Listener at localhost/33723] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:06,611 INFO [Listener at localhost/33723] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:06,611 INFO [Listener at localhost/33723] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42497 connecting to ZooKeeper ensemble=127.0.0.1:55171 2023-02-12 06:03:06,619 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:424970x0, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 06:03:06,619 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:42497-0x100472039a20000 connected 2023-02-12 06:03:06,648 DEBUG [Listener at localhost/33723] zookeeper.ZKUtil(164): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 06:03:06,649 DEBUG [Listener at localhost/33723] zookeeper.ZKUtil(164): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:03:06,649 DEBUG [Listener at localhost/33723] zookeeper.ZKUtil(164): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 06:03:06,649 DEBUG [Listener at localhost/33723] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42497 2023-02-12 06:03:06,652 DEBUG [Listener at localhost/33723] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42497 2023-02-12 06:03:06,652 DEBUG [Listener at localhost/33723] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42497 2023-02-12 06:03:06,653 DEBUG [Listener at localhost/33723] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42497 2023-02-12 06:03:06,654 DEBUG [Listener at localhost/33723] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42497 2023-02-12 06:03:06,654 INFO [Listener at localhost/33723] master.HMaster(439): hbase.rootdir=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6, hbase.cluster.distributed=false 2023-02-12 06:03:06,668 INFO [Listener at localhost/33723] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 06:03:06,668 INFO [Listener at localhost/33723] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:06,668 INFO [Listener at localhost/33723] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:06,668 INFO [Listener at localhost/33723] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 06:03:06,669 INFO [Listener at localhost/33723] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:06,669 INFO [Listener at localhost/33723] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 06:03:06,669 INFO [Listener at localhost/33723] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 06:03:06,671 INFO [Listener at localhost/33723] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46075 2023-02-12 06:03:06,672 INFO [Listener at localhost/33723] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 06:03:06,674 DEBUG [Listener at localhost/33723] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:03:06,675 INFO [Listener at localhost/33723] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:06,676 INFO [Listener at localhost/33723] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:06,677 INFO [Listener at localhost/33723] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46075 connecting to ZooKeeper ensemble=127.0.0.1:55171 2023-02-12 06:03:06,680 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): regionserver:460750x0, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 06:03:06,681 DEBUG [Listener at localhost/33723] zookeeper.ZKUtil(164): regionserver:460750x0, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 06:03:06,681 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:46075-0x100472039a20001 connected 2023-02-12 06:03:06,682 DEBUG [Listener at localhost/33723] zookeeper.ZKUtil(164): regionserver:46075-0x100472039a20001, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:03:06,682 DEBUG [Listener at localhost/33723] zookeeper.ZKUtil(164): regionserver:46075-0x100472039a20001, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 06:03:06,684 DEBUG [Listener at localhost/33723] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46075 2023-02-12 06:03:06,688 DEBUG [Listener at localhost/33723] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46075 2023-02-12 06:03:06,688 DEBUG [Listener at localhost/33723] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46075 2023-02-12 06:03:06,688 DEBUG [Listener at localhost/33723] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46075 2023-02-12 06:03:06,690 DEBUG [Listener at localhost/33723] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46075 2023-02-12 06:03:06,707 INFO [Listener at localhost/33723] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 06:03:06,707 INFO [Listener at localhost/33723] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:06,707 INFO [Listener at localhost/33723] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:06,707 INFO [Listener at localhost/33723] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 06:03:06,707 INFO [Listener at localhost/33723] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:06,708 INFO [Listener at localhost/33723] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 06:03:06,708 INFO [Listener at localhost/33723] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 06:03:06,709 INFO [Listener at localhost/33723] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34015 2023-02-12 06:03:06,710 INFO [Listener at localhost/33723] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 06:03:06,711 DEBUG [Listener at localhost/33723] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:03:06,711 INFO [Listener at localhost/33723] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:06,712 INFO [Listener at localhost/33723] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:06,714 INFO [Listener at localhost/33723] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34015 connecting to ZooKeeper ensemble=127.0.0.1:55171 2023-02-12 06:03:06,717 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): regionserver:340150x0, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 06:03:06,719 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:34015-0x100472039a20002 connected 2023-02-12 06:03:06,719 DEBUG [Listener at localhost/33723] zookeeper.ZKUtil(164): regionserver:34015-0x100472039a20002, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 06:03:06,719 DEBUG [Listener at localhost/33723] zookeeper.ZKUtil(164): regionserver:34015-0x100472039a20002, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:03:06,720 DEBUG [Listener at localhost/33723] zookeeper.ZKUtil(164): regionserver:34015-0x100472039a20002, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 06:03:06,720 DEBUG [Listener at localhost/33723] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34015 2023-02-12 06:03:06,721 DEBUG [Listener at localhost/33723] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34015 2023-02-12 06:03:06,724 DEBUG [Listener at localhost/33723] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34015 2023-02-12 06:03:06,724 DEBUG [Listener at localhost/33723] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34015 2023-02-12 06:03:06,724 DEBUG [Listener at localhost/33723] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34015 2023-02-12 06:03:06,725 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,42497,1676181786607 2023-02-12 06:03:06,727 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 06:03:06,727 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,42497,1676181786607 2023-02-12 06:03:06,729 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 06:03:06,729 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): regionserver:34015-0x100472039a20002, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 06:03:06,729 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:06,729 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): regionserver:46075-0x100472039a20001, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 06:03:06,731 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 06:03:06,732 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 06:03:06,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,42497,1676181786607 from backup master directory 2023-02-12 06:03:06,733 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,42497,1676181786607 2023-02-12 06:03:06,733 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 06:03:06,733 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 06:03:06,733 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,42497,1676181786607 2023-02-12 06:03:06,747 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/hbase.id with ID: 6756df8f-0f1f-452c-a760-136030cf15b7 2023-02-12 06:03:06,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:06,760 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:06,770 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x3c36470d to 127.0.0.1:55171 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 06:03:06,777 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40f41b58, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 06:03:06,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 06:03:06,778 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-12 06:03:06,778 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 06:03:06,779 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/MasterData/data/master/store-tmp 2023-02-12 06:03:06,790 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:06,790 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 06:03:06,790 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:06,790 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:06,790 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 06:03:06,790 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:06,790 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:06,790 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676181786790Disabling compacts and flushes for region at 1676181786790Disabling writes for close at 1676181786790Writing region close event to WAL at 1676181786790Closed at 1676181786790 2023-02-12 06:03:06,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/MasterData/WALs/jenkins-hbase4.apache.org,42497,1676181786607 2023-02-12 06:03:06,793 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42497%2C1676181786607, suffix=, logDir=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/MasterData/WALs/jenkins-hbase4.apache.org,42497,1676181786607, archiveDir=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/MasterData/oldWALs, maxLogs=10 2023-02-12 06:03:06,816 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41943,DS-29dafe85-6d60-401c-8fd3-2e5ebb3cfff7,DISK] 2023-02-12 06:03:06,816 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39301,DS-0cbfb90a-d959-4176-b114-a170c3458ad0,DISK] 2023-02-12 06:03:06,818 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/MasterData/WALs/jenkins-hbase4.apache.org,42497,1676181786607/jenkins-hbase4.apache.org%2C42497%2C1676181786607.1676181786793 2023-02-12 06:03:06,819 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41943,DS-29dafe85-6d60-401c-8fd3-2e5ebb3cfff7,DISK], DatanodeInfoWithStorage[127.0.0.1:39301,DS-0cbfb90a-d959-4176-b114-a170c3458ad0,DISK]] 2023-02-12 06:03:06,819 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-12 06:03:06,819 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:06,819 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:03:06,819 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:03:06,821 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:03:06,822 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-12 06:03:06,822 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-12 06:03:06,823 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:06,824 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:03:06,824 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:03:06,826 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:03:06,828 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:03:06,829 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67986353, jitterRate=0.013075605034828186}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 06:03:06,829 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676181786819Initializing all the Stores at 1676181786820 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181786820Cleaning up temporary data from old regions at 1676181786824 (+4 ms)Cleaning up detritus from prior splits at 1676181786825 (+1 ms)Region opened successfully at 1676181786829 (+4 ms) 2023-02-12 06:03:06,829 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-12 06:03:06,830 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-12 06:03:06,830 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-12 06:03:06,830 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-12 06:03:06,831 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-12 06:03:06,831 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-12 06:03:06,831 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-12 06:03:06,832 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-12 06:03:06,833 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-12 06:03:06,843 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-12 06:03:06,843 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-12 06:03:06,843 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-12 06:03:06,843 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-12 06:03:06,844 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-12 06:03:06,847 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:06,847 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-12 06:03:06,848 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-12 06:03:06,848 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-12 06:03:06,849 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 06:03:06,849 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): regionserver:34015-0x100472039a20002, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 06:03:06,850 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): regionserver:46075-0x100472039a20001, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 06:03:06,849 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:06,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,42497,1676181786607, sessionid=0x100472039a20000, setting cluster-up flag (Was=false) 2023-02-12 06:03:06,854 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:06,859 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-12 06:03:06,859 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42497,1676181786607 2023-02-12 06:03:06,863 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:06,866 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-12 06:03:06,866 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42497,1676181786607 2023-02-12 06:03:06,867 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/.hbase-snapshot/.tmp 2023-02-12 06:03:06,868 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-12 06:03:06,868 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 06:03:06,868 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 06:03:06,868 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 06:03:06,868 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 06:03:06,868 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-12 06:03:06,869 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:06,869 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 06:03:06,869 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:06,870 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676181816870 2023-02-12 06:03:06,870 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-12 06:03:06,870 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-12 06:03:06,870 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-12 06:03:06,870 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-12 06:03:06,870 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-12 06:03:06,870 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-12 06:03:06,870 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:06,871 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 06:03:06,871 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-12 06:03:06,871 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-12 06:03:06,871 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-12 06:03:06,871 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-12 06:03:06,872 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-12 06:03:06,872 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-12 06:03:06,872 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676181786872,5,FailOnTimeoutGroup] 2023-02-12 06:03:06,872 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676181786872,5,FailOnTimeoutGroup] 2023-02-12 06:03:06,872 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:06,872 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-12 06:03:06,872 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:06,872 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:06,872 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 06:03:06,885 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 06:03:06,885 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 06:03:06,885 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6 2023-02-12 06:03:06,896 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:06,902 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 06:03:06,903 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/hbase/meta/1588230740/info 2023-02-12 06:03:06,903 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 06:03:06,904 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:06,904 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 06:03:06,905 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/hbase/meta/1588230740/rep_barrier 2023-02-12 06:03:06,905 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 06:03:06,905 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:06,905 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 06:03:06,906 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/hbase/meta/1588230740/table 2023-02-12 06:03:06,906 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 06:03:06,907 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:06,907 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/hbase/meta/1588230740 2023-02-12 06:03:06,908 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/hbase/meta/1588230740 2023-02-12 06:03:06,909 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 06:03:06,910 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 06:03:06,912 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:03:06,912 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73337868, jitterRate=0.09281939268112183}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 06:03:06,912 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676181786896Initializing all the Stores at 1676181786897 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676181786897Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181786901 (+4 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676181786901Cleaning up temporary data from old regions at 1676181786909 (+8 ms)Cleaning up detritus from prior splits at 1676181786909Region opened successfully at 1676181786912 (+3 ms) 2023-02-12 06:03:06,912 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 06:03:06,912 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 06:03:06,913 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 06:03:06,913 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 06:03:06,913 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 06:03:06,913 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 06:03:06,913 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676181786912Disabling compacts and flushes for region at 1676181786912Disabling writes for close at 1676181786913 (+1 ms)Writing region close event to WAL at 1676181786913Closed at 1676181786913 2023-02-12 06:03:06,914 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 06:03:06,914 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-12 06:03:06,914 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-12 06:03:06,915 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-12 06:03:06,917 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-12 06:03:06,926 INFO [RS:0;jenkins-hbase4:46075] regionserver.HRegionServer(952): ClusterId : 6756df8f-0f1f-452c-a760-136030cf15b7 2023-02-12 06:03:06,926 INFO [RS:1;jenkins-hbase4:34015] regionserver.HRegionServer(952): ClusterId : 6756df8f-0f1f-452c-a760-136030cf15b7 2023-02-12 06:03:06,926 DEBUG [RS:0;jenkins-hbase4:46075] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 06:03:06,926 DEBUG [RS:1;jenkins-hbase4:34015] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 06:03:06,930 DEBUG [RS:0;jenkins-hbase4:46075] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 06:03:06,930 DEBUG [RS:0;jenkins-hbase4:46075] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 06:03:06,930 DEBUG [RS:1;jenkins-hbase4:34015] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 06:03:06,930 DEBUG [RS:1;jenkins-hbase4:34015] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 06:03:06,932 DEBUG [RS:0;jenkins-hbase4:46075] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 06:03:06,932 DEBUG [RS:0;jenkins-hbase4:46075] zookeeper.ReadOnlyZKClient(139): Connect 0x18aa2cfb to 127.0.0.1:55171 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 06:03:06,932 DEBUG [RS:1;jenkins-hbase4:34015] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 06:03:06,933 DEBUG [RS:1;jenkins-hbase4:34015] zookeeper.ReadOnlyZKClient(139): Connect 0x58312236 to 127.0.0.1:55171 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 06:03:06,939 DEBUG [RS:0;jenkins-hbase4:46075] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@166dc19e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 06:03:06,939 DEBUG [RS:1;jenkins-hbase4:34015] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56f6d740, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 06:03:06,939 DEBUG [RS:0;jenkins-hbase4:46075] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1252478b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 06:03:06,940 DEBUG [RS:1;jenkins-hbase4:34015] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52c94946, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 06:03:06,948 DEBUG [RS:1;jenkins-hbase4:34015] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:34015 2023-02-12 06:03:06,948 DEBUG [RS:0;jenkins-hbase4:46075] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:46075 2023-02-12 06:03:06,948 INFO [RS:1;jenkins-hbase4:34015] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 06:03:06,949 INFO [RS:0;jenkins-hbase4:46075] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 06:03:06,949 INFO [RS:1;jenkins-hbase4:34015] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 06:03:06,949 DEBUG [RS:1;jenkins-hbase4:34015] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 06:03:06,949 INFO [RS:0;jenkins-hbase4:46075] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 06:03:06,949 DEBUG [RS:0;jenkins-hbase4:46075] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 06:03:06,949 INFO [RS:0;jenkins-hbase4:46075] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,42497,1676181786607 with isa=jenkins-hbase4.apache.org/172.31.14.131:46075, startcode=1676181786668 2023-02-12 06:03:06,949 INFO [RS:1;jenkins-hbase4:34015] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,42497,1676181786607 with isa=jenkins-hbase4.apache.org/172.31.14.131:34015, startcode=1676181786706 2023-02-12 06:03:06,949 DEBUG [RS:0;jenkins-hbase4:46075] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 06:03:06,949 DEBUG [RS:1;jenkins-hbase4:34015] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 06:03:06,951 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40163, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 06:03:06,952 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42185, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 06:03:06,953 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42497] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46075,1676181786668 2023-02-12 06:03:06,953 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:06,953 DEBUG [RS:0;jenkins-hbase4:46075] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6 2023-02-12 06:03:06,954 DEBUG [RS:1;jenkins-hbase4:34015] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6 2023-02-12 06:03:06,954 DEBUG [RS:0;jenkins-hbase4:46075] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36613 2023-02-12 06:03:06,954 DEBUG [RS:0;jenkins-hbase4:46075] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 06:03:06,954 DEBUG [RS:1;jenkins-hbase4:34015] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36613 2023-02-12 06:03:06,954 DEBUG [RS:1;jenkins-hbase4:34015] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 06:03:06,958 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 06:03:06,959 DEBUG [RS:0;jenkins-hbase4:46075] zookeeper.ZKUtil(162): regionserver:46075-0x100472039a20001, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46075,1676181786668 2023-02-12 06:03:06,959 DEBUG [RS:1;jenkins-hbase4:34015] zookeeper.ZKUtil(162): regionserver:34015-0x100472039a20002, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:06,959 WARN [RS:0;jenkins-hbase4:46075] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 06:03:06,959 WARN [RS:1;jenkins-hbase4:34015] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 06:03:06,959 INFO [RS:0;jenkins-hbase4:46075] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 06:03:06,959 INFO [RS:1;jenkins-hbase4:34015] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 06:03:06,959 DEBUG [RS:0;jenkins-hbase4:46075] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/WALs/jenkins-hbase4.apache.org,46075,1676181786668 2023-02-12 06:03:06,959 DEBUG [RS:1;jenkins-hbase4:34015] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/WALs/jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:06,959 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34015,1676181786706] 2023-02-12 06:03:06,959 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46075,1676181786668] 2023-02-12 06:03:06,964 DEBUG [RS:1;jenkins-hbase4:34015] zookeeper.ZKUtil(162): regionserver:34015-0x100472039a20002, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:06,965 DEBUG [RS:0;jenkins-hbase4:46075] zookeeper.ZKUtil(162): regionserver:46075-0x100472039a20001, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:06,965 DEBUG [RS:1;jenkins-hbase4:34015] zookeeper.ZKUtil(162): regionserver:34015-0x100472039a20002, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46075,1676181786668 2023-02-12 06:03:06,965 DEBUG [RS:0;jenkins-hbase4:46075] zookeeper.ZKUtil(162): regionserver:46075-0x100472039a20001, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46075,1676181786668 2023-02-12 06:03:06,966 DEBUG [RS:1;jenkins-hbase4:34015] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 06:03:06,966 DEBUG [RS:0;jenkins-hbase4:46075] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 06:03:06,966 INFO [RS:1;jenkins-hbase4:34015] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 06:03:06,966 INFO [RS:0;jenkins-hbase4:46075] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 06:03:06,967 INFO [RS:1;jenkins-hbase4:34015] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 06:03:06,968 INFO [RS:1;jenkins-hbase4:34015] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 06:03:06,968 INFO [RS:0;jenkins-hbase4:46075] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 06:03:06,968 INFO [RS:1;jenkins-hbase4:34015] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:06,972 INFO [RS:0;jenkins-hbase4:46075] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 06:03:06,972 INFO [RS:0;jenkins-hbase4:46075] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:06,972 INFO [RS:1;jenkins-hbase4:34015] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 06:03:06,972 INFO [RS:0;jenkins-hbase4:46075] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 06:03:06,973 INFO [RS:1;jenkins-hbase4:34015] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:06,973 INFO [RS:0;jenkins-hbase4:46075] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:06,974 DEBUG [RS:1;jenkins-hbase4:34015] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:06,974 DEBUG [RS:0;jenkins-hbase4:46075] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:06,974 DEBUG [RS:1;jenkins-hbase4:34015] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:06,974 DEBUG [RS:0;jenkins-hbase4:46075] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:06,974 DEBUG [RS:1;jenkins-hbase4:34015] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:06,975 DEBUG [RS:0;jenkins-hbase4:46075] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:06,975 DEBUG [RS:1;jenkins-hbase4:34015] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:06,975 DEBUG [RS:0;jenkins-hbase4:46075] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:06,975 DEBUG [RS:1;jenkins-hbase4:34015] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:06,975 DEBUG [RS:0;jenkins-hbase4:46075] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:06,975 DEBUG [RS:1;jenkins-hbase4:34015] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 06:03:06,975 DEBUG [RS:0;jenkins-hbase4:46075] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 06:03:06,975 DEBUG [RS:1;jenkins-hbase4:34015] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:06,975 DEBUG [RS:0;jenkins-hbase4:46075] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:06,975 DEBUG [RS:1;jenkins-hbase4:34015] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:06,975 DEBUG [RS:0;jenkins-hbase4:46075] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:06,975 DEBUG [RS:1;jenkins-hbase4:34015] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:06,975 DEBUG [RS:0;jenkins-hbase4:46075] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:06,975 DEBUG [RS:1;jenkins-hbase4:34015] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:06,975 DEBUG [RS:0;jenkins-hbase4:46075] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:06,979 INFO [RS:1;jenkins-hbase4:34015] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:06,979 INFO [RS:1;jenkins-hbase4:34015] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:06,980 INFO [RS:0;jenkins-hbase4:46075] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:06,980 INFO [RS:1;jenkins-hbase4:34015] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:06,980 INFO [RS:0;jenkins-hbase4:46075] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:06,980 INFO [RS:0;jenkins-hbase4:46075] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:06,991 INFO [RS:0;jenkins-hbase4:46075] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 06:03:06,991 INFO [RS:1;jenkins-hbase4:34015] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 06:03:06,991 INFO [RS:0;jenkins-hbase4:46075] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46075,1676181786668-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:06,991 INFO [RS:1;jenkins-hbase4:34015] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34015,1676181786706-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:07,004 INFO [RS:0;jenkins-hbase4:46075] regionserver.Replication(203): jenkins-hbase4.apache.org,46075,1676181786668 started 2023-02-12 06:03:07,004 INFO [RS:1;jenkins-hbase4:34015] regionserver.Replication(203): jenkins-hbase4.apache.org,34015,1676181786706 started 2023-02-12 06:03:07,004 INFO [RS:0;jenkins-hbase4:46075] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,46075,1676181786668, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46075, sessionid=0x100472039a20001 2023-02-12 06:03:07,004 INFO [RS:1;jenkins-hbase4:34015] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,34015,1676181786706, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34015, sessionid=0x100472039a20002 2023-02-12 06:03:07,004 DEBUG [RS:0;jenkins-hbase4:46075] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 06:03:07,004 DEBUG [RS:1;jenkins-hbase4:34015] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 06:03:07,004 DEBUG [RS:0;jenkins-hbase4:46075] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46075,1676181786668 2023-02-12 06:03:07,004 DEBUG [RS:1;jenkins-hbase4:34015] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:07,004 DEBUG [RS:0;jenkins-hbase4:46075] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46075,1676181786668' 2023-02-12 06:03:07,004 DEBUG [RS:1;jenkins-hbase4:34015] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34015,1676181786706' 2023-02-12 06:03:07,004 DEBUG [RS:0;jenkins-hbase4:46075] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:03:07,004 DEBUG [RS:1;jenkins-hbase4:34015] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:03:07,005 DEBUG [RS:0;jenkins-hbase4:46075] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:03:07,005 DEBUG [RS:1;jenkins-hbase4:34015] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:03:07,005 DEBUG [RS:0;jenkins-hbase4:46075] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 06:03:07,005 DEBUG [RS:1;jenkins-hbase4:34015] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 06:03:07,005 DEBUG [RS:0;jenkins-hbase4:46075] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 06:03:07,005 DEBUG [RS:1;jenkins-hbase4:34015] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 06:03:07,005 DEBUG [RS:0;jenkins-hbase4:46075] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46075,1676181786668 2023-02-12 06:03:07,005 DEBUG [RS:0;jenkins-hbase4:46075] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46075,1676181786668' 2023-02-12 06:03:07,005 DEBUG [RS:0;jenkins-hbase4:46075] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:03:07,005 DEBUG [RS:1;jenkins-hbase4:34015] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:07,005 DEBUG [RS:1;jenkins-hbase4:34015] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34015,1676181786706' 2023-02-12 06:03:07,005 DEBUG [RS:1;jenkins-hbase4:34015] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:03:07,005 DEBUG [RS:0;jenkins-hbase4:46075] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:03:07,005 DEBUG [RS:1;jenkins-hbase4:34015] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:03:07,006 DEBUG [RS:0;jenkins-hbase4:46075] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 06:03:07,006 INFO [RS:0;jenkins-hbase4:46075] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 06:03:07,006 INFO [RS:0;jenkins-hbase4:46075] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 06:03:07,006 DEBUG [RS:1;jenkins-hbase4:34015] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 06:03:07,006 INFO [RS:1;jenkins-hbase4:34015] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 06:03:07,006 INFO [RS:1;jenkins-hbase4:34015] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 06:03:07,067 DEBUG [jenkins-hbase4:42497] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-12 06:03:07,067 DEBUG [jenkins-hbase4:42497] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 06:03:07,069 DEBUG [jenkins-hbase4:42497] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 06:03:07,069 DEBUG [jenkins-hbase4:42497] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 06:03:07,069 DEBUG [jenkins-hbase4:42497] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 06:03:07,070 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46075,1676181786668, state=OPENING 2023-02-12 06:03:07,071 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-12 06:03:07,072 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:07,073 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 06:03:07,073 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46075,1676181786668}] 2023-02-12 06:03:07,227 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46075,1676181786668 2023-02-12 06:03:07,227 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 06:03:07,229 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44176, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 06:03:07,234 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-12 06:03:07,234 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 06:03:07,235 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46075%2C1676181786668.meta, suffix=.meta, logDir=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/WALs/jenkins-hbase4.apache.org,46075,1676181786668, archiveDir=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/oldWALs, maxLogs=32 2023-02-12 06:03:07,252 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39301,DS-0cbfb90a-d959-4176-b114-a170c3458ad0,DISK] 2023-02-12 06:03:07,253 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41943,DS-29dafe85-6d60-401c-8fd3-2e5ebb3cfff7,DISK] 2023-02-12 06:03:07,254 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/WALs/jenkins-hbase4.apache.org,46075,1676181786668/jenkins-hbase4.apache.org%2C46075%2C1676181786668.meta.1676181787236.meta 2023-02-12 06:03:07,257 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39301,DS-0cbfb90a-d959-4176-b114-a170c3458ad0,DISK], DatanodeInfoWithStorage[127.0.0.1:41943,DS-29dafe85-6d60-401c-8fd3-2e5ebb3cfff7,DISK]] 2023-02-12 06:03:07,257 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-12 06:03:07,258 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-12 06:03:07,258 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-12 06:03:07,258 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-12 06:03:07,258 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-12 06:03:07,258 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:07,258 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-12 06:03:07,258 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-12 06:03:07,259 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 06:03:07,260 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/hbase/meta/1588230740/info 2023-02-12 06:03:07,260 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/hbase/meta/1588230740/info 2023-02-12 06:03:07,261 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 06:03:07,261 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:07,261 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 06:03:07,262 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/hbase/meta/1588230740/rep_barrier 2023-02-12 06:03:07,262 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/hbase/meta/1588230740/rep_barrier 2023-02-12 06:03:07,263 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 06:03:07,263 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:07,263 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 06:03:07,264 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/hbase/meta/1588230740/table 2023-02-12 06:03:07,264 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/hbase/meta/1588230740/table 2023-02-12 06:03:07,265 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 06:03:07,265 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:07,266 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/hbase/meta/1588230740 2023-02-12 06:03:07,267 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/hbase/meta/1588230740 2023-02-12 06:03:07,269 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 06:03:07,270 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 06:03:07,271 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73452358, jitterRate=0.09452542662620544}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 06:03:07,271 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676181787258Writing region info on filesystem at 1676181787258Initializing all the Stores at 1676181787259 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676181787259Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181787259Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676181787259Cleaning up temporary data from old regions at 1676181787268 (+9 ms)Cleaning up detritus from prior splits at 1676181787268Running coprocessor post-open hooks at 1676181787271 (+3 ms)Region opened successfully at 1676181787271 2023-02-12 06:03:07,272 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676181787227 2023-02-12 06:03:07,275 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-12 06:03:07,276 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-12 06:03:07,276 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46075,1676181786668, state=OPEN 2023-02-12 06:03:07,277 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-12 06:03:07,277 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 06:03:07,279 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-12 06:03:07,279 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46075,1676181786668 in 204 msec 2023-02-12 06:03:07,280 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-12 06:03:07,281 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 365 msec 2023-02-12 06:03:07,282 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 414 msec 2023-02-12 06:03:07,282 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676181786727, completionTime=-1 2023-02-12 06:03:07,282 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-12 06:03:07,282 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-12 06:03:07,285 DEBUG [hconnection-0x1048841-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 06:03:07,286 INFO [RS-EventLoopGroup-10-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44186, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 06:03:07,288 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-12 06:03:07,288 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676181847288 2023-02-12 06:03:07,288 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676181907288 2023-02-12 06:03:07,288 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-12 06:03:07,296 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42497,1676181786607-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:07,296 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42497,1676181786607-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:07,296 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42497,1676181786607-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:07,296 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:42497, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:07,296 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:07,296 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-12 06:03:07,296 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 06:03:07,297 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-12 06:03:07,298 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-12 06:03:07,298 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 06:03:07,299 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 06:03:07,300 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/.tmp/data/hbase/namespace/a7e7a28af6137484561bbdada3875902 2023-02-12 06:03:07,301 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/.tmp/data/hbase/namespace/a7e7a28af6137484561bbdada3875902 empty. 2023-02-12 06:03:07,301 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/.tmp/data/hbase/namespace/a7e7a28af6137484561bbdada3875902 2023-02-12 06:03:07,301 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-12 06:03:07,310 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-12 06:03:07,311 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => a7e7a28af6137484561bbdada3875902, NAME => 'hbase:namespace,,1676181787296.a7e7a28af6137484561bbdada3875902.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/.tmp 2023-02-12 06:03:07,318 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676181787296.a7e7a28af6137484561bbdada3875902.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:07,318 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing a7e7a28af6137484561bbdada3875902, disabling compactions & flushes 2023-02-12 06:03:07,318 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676181787296.a7e7a28af6137484561bbdada3875902. 2023-02-12 06:03:07,318 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676181787296.a7e7a28af6137484561bbdada3875902. 2023-02-12 06:03:07,318 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676181787296.a7e7a28af6137484561bbdada3875902. after waiting 0 ms 2023-02-12 06:03:07,318 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676181787296.a7e7a28af6137484561bbdada3875902. 2023-02-12 06:03:07,318 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676181787296.a7e7a28af6137484561bbdada3875902. 2023-02-12 06:03:07,318 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for a7e7a28af6137484561bbdada3875902: Waiting for close lock at 1676181787318Disabling compacts and flushes for region at 1676181787318Disabling writes for close at 1676181787318Writing region close event to WAL at 1676181787318Closed at 1676181787318 2023-02-12 06:03:07,320 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 06:03:07,321 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676181787296.a7e7a28af6137484561bbdada3875902.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676181787321"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181787321"}]},"ts":"1676181787321"} 2023-02-12 06:03:07,323 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 06:03:07,324 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 06:03:07,324 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676181787324"}]},"ts":"1676181787324"} 2023-02-12 06:03:07,326 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-12 06:03:07,331 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 06:03:07,332 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 06:03:07,332 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 06:03:07,332 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 06:03:07,332 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a7e7a28af6137484561bbdada3875902, ASSIGN}] 2023-02-12 06:03:07,334 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a7e7a28af6137484561bbdada3875902, ASSIGN 2023-02-12 06:03:07,335 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=a7e7a28af6137484561bbdada3875902, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46075,1676181786668; forceNewPlan=false, retain=false 2023-02-12 06:03:07,485 INFO [jenkins-hbase4:42497] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 06:03:07,486 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a7e7a28af6137484561bbdada3875902, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46075,1676181786668 2023-02-12 06:03:07,486 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676181787296.a7e7a28af6137484561bbdada3875902.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676181787486"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181787486"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181787486"}]},"ts":"1676181787486"} 2023-02-12 06:03:07,488 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure a7e7a28af6137484561bbdada3875902, server=jenkins-hbase4.apache.org,46075,1676181786668}] 2023-02-12 06:03:07,643 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676181787296.a7e7a28af6137484561bbdada3875902. 2023-02-12 06:03:07,645 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46075%2C1676181786668, suffix=, logDir=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/WALs/jenkins-hbase4.apache.org,46075,1676181786668, archiveDir=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/oldWALs, maxLogs=32 2023-02-12 06:03:07,659 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41943,DS-29dafe85-6d60-401c-8fd3-2e5ebb3cfff7,DISK] 2023-02-12 06:03:07,659 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39301,DS-0cbfb90a-d959-4176-b114-a170c3458ad0,DISK] 2023-02-12 06:03:07,661 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/WALs/jenkins-hbase4.apache.org,46075,1676181786668/jenkins-hbase4.apache.org%2C46075%2C1676181786668.1676181787645 2023-02-12 06:03:07,661 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39301,DS-0cbfb90a-d959-4176-b114-a170c3458ad0,DISK], DatanodeInfoWithStorage[127.0.0.1:41943,DS-29dafe85-6d60-401c-8fd3-2e5ebb3cfff7,DISK]] 2023-02-12 06:03:07,662 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a7e7a28af6137484561bbdada3875902, NAME => 'hbase:namespace,,1676181787296.a7e7a28af6137484561bbdada3875902.', STARTKEY => '', ENDKEY => ''} 2023-02-12 06:03:07,662 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace a7e7a28af6137484561bbdada3875902 2023-02-12 06:03:07,662 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676181787296.a7e7a28af6137484561bbdada3875902.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:07,662 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for a7e7a28af6137484561bbdada3875902 2023-02-12 06:03:07,662 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for a7e7a28af6137484561bbdada3875902 2023-02-12 06:03:07,663 INFO [StoreOpener-a7e7a28af6137484561bbdada3875902-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region a7e7a28af6137484561bbdada3875902 2023-02-12 06:03:07,664 DEBUG [StoreOpener-a7e7a28af6137484561bbdada3875902-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/hbase/namespace/a7e7a28af6137484561bbdada3875902/info 2023-02-12 06:03:07,664 DEBUG [StoreOpener-a7e7a28af6137484561bbdada3875902-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/hbase/namespace/a7e7a28af6137484561bbdada3875902/info 2023-02-12 06:03:07,665 INFO [StoreOpener-a7e7a28af6137484561bbdada3875902-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a7e7a28af6137484561bbdada3875902 columnFamilyName info 2023-02-12 06:03:07,665 INFO [StoreOpener-a7e7a28af6137484561bbdada3875902-1] regionserver.HStore(310): Store=a7e7a28af6137484561bbdada3875902/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:07,666 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/hbase/namespace/a7e7a28af6137484561bbdada3875902 2023-02-12 06:03:07,666 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/hbase/namespace/a7e7a28af6137484561bbdada3875902 2023-02-12 06:03:07,668 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for a7e7a28af6137484561bbdada3875902 2023-02-12 06:03:07,670 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/hbase/namespace/a7e7a28af6137484561bbdada3875902/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:03:07,670 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened a7e7a28af6137484561bbdada3875902; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73117123, jitterRate=0.08953003585338593}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 06:03:07,671 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for a7e7a28af6137484561bbdada3875902: Running coprocessor pre-open hook at 1676181787662Writing region info on filesystem at 1676181787662Initializing all the Stores at 1676181787663 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676181787663Cleaning up temporary data from old regions at 1676181787666 (+3 ms)Cleaning up detritus from prior splits at 1676181787667 (+1 ms)Running coprocessor post-open hooks at 1676181787670 (+3 ms)Region opened successfully at 1676181787670 2023-02-12 06:03:07,671 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676181787296.a7e7a28af6137484561bbdada3875902., pid=6, masterSystemTime=1676181787640 2023-02-12 06:03:07,673 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676181787296.a7e7a28af6137484561bbdada3875902. 2023-02-12 06:03:07,674 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676181787296.a7e7a28af6137484561bbdada3875902. 2023-02-12 06:03:07,674 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a7e7a28af6137484561bbdada3875902, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46075,1676181786668 2023-02-12 06:03:07,674 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676181787296.a7e7a28af6137484561bbdada3875902.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676181787674"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676181787674"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676181787674"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676181787674"}]},"ts":"1676181787674"} 2023-02-12 06:03:07,677 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-12 06:03:07,677 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure a7e7a28af6137484561bbdada3875902, server=jenkins-hbase4.apache.org,46075,1676181786668 in 188 msec 2023-02-12 06:03:07,678 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-12 06:03:07,679 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=a7e7a28af6137484561bbdada3875902, ASSIGN in 345 msec 2023-02-12 06:03:07,679 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 06:03:07,679 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676181787679"}]},"ts":"1676181787679"} 2023-02-12 06:03:07,681 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-12 06:03:07,684 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 06:03:07,685 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 388 msec 2023-02-12 06:03:07,698 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-12 06:03:07,699 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-12 06:03:07,699 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:07,702 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-12 06:03:07,709 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 06:03:07,712 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-12 06:03:07,714 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-12 06:03:07,721 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 06:03:07,723 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-12 06:03:07,728 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-12 06:03:07,731 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-12 06:03:07,731 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.998sec 2023-02-12 06:03:07,731 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-12 06:03:07,731 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-12 06:03:07,731 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-12 06:03:07,731 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42497,1676181786607-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-12 06:03:07,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42497,1676181786607-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-12 06:03:07,735 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-12 06:03:07,827 DEBUG [Listener at localhost/33723] zookeeper.ReadOnlyZKClient(139): Connect 0x061cb79f to 127.0.0.1:55171 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 06:03:07,833 DEBUG [Listener at localhost/33723] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20db0c0f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 06:03:07,834 DEBUG [hconnection-0x3a6963a0-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 06:03:07,836 INFO [RS-EventLoopGroup-10-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44192, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 06:03:07,838 INFO [Listener at localhost/33723] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,42497,1676181786607 2023-02-12 06:03:07,838 DEBUG [Listener at localhost/33723] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-12 06:03:07,840 DEBUG [Listener at localhost/33723] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 06:03:07,842 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46902, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 06:03:07,842 INFO [Listener at localhost/33723] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:07,843 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:07,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-12 06:03:07,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 96 connection: 172.31.14.131:46902 deadline: 1676181847843, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:07,843 INFO [Listener at localhost/33723] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-12 06:03:07,846 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 06:03:07,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:07,848 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 06:03:07,849 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-12 06:03:07,849 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 06:03:07,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 06:03:07,851 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/.tmp/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e 2023-02-12 06:03:07,852 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/.tmp/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e empty. 2023-02-12 06:03:07,852 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/.tmp/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e 2023-02-12 06:03:07,852 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-12 06:03:07,862 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-12 06:03:07,864 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => 403140db80c94e00c847bf717ba7ee5e, NAME => 'testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/.tmp 2023-02-12 06:03:07,870 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:07,871 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing 403140db80c94e00c847bf717ba7ee5e, disabling compactions & flushes 2023-02-12 06:03:07,871 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e. 2023-02-12 06:03:07,871 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e. 2023-02-12 06:03:07,871 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e. after waiting 0 ms 2023-02-12 06:03:07,871 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e. 2023-02-12 06:03:07,871 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e. 2023-02-12 06:03:07,871 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for 403140db80c94e00c847bf717ba7ee5e: Waiting for close lock at 1676181787871Disabling compacts and flushes for region at 1676181787871Disabling writes for close at 1676181787871Writing region close event to WAL at 1676181787871Closed at 1676181787871 2023-02-12 06:03:07,873 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 06:03:07,874 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676181787874"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181787874"}]},"ts":"1676181787874"} 2023-02-12 06:03:07,876 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 06:03:07,876 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 06:03:07,877 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676181787877"}]},"ts":"1676181787877"} 2023-02-12 06:03:07,878 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-12 06:03:07,882 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 06:03:07,883 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 06:03:07,883 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 06:03:07,883 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 06:03:07,884 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=403140db80c94e00c847bf717ba7ee5e, ASSIGN}] 2023-02-12 06:03:07,886 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=403140db80c94e00c847bf717ba7ee5e, ASSIGN 2023-02-12 06:03:07,886 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=403140db80c94e00c847bf717ba7ee5e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34015,1676181786706; forceNewPlan=false, retain=false 2023-02-12 06:03:07,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 06:03:08,008 INFO [RS:1;jenkins-hbase4:34015] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34015%2C1676181786706, suffix=, logDir=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/WALs/jenkins-hbase4.apache.org,34015,1676181786706, archiveDir=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/oldWALs, maxLogs=32 2023-02-12 06:03:08,024 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39301,DS-0cbfb90a-d959-4176-b114-a170c3458ad0,DISK] 2023-02-12 06:03:08,024 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41943,DS-29dafe85-6d60-401c-8fd3-2e5ebb3cfff7,DISK] 2023-02-12 06:03:08,025 INFO [RS:1;jenkins-hbase4:34015] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/WALs/jenkins-hbase4.apache.org,34015,1676181786706/jenkins-hbase4.apache.org%2C34015%2C1676181786706.1676181788008 2023-02-12 06:03:08,026 DEBUG [RS:1;jenkins-hbase4:34015] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41943,DS-29dafe85-6d60-401c-8fd3-2e5ebb3cfff7,DISK], DatanodeInfoWithStorage[127.0.0.1:39301,DS-0cbfb90a-d959-4176-b114-a170c3458ad0,DISK]] 2023-02-12 06:03:08,037 INFO [jenkins-hbase4:42497] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 06:03:08,037 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=403140db80c94e00c847bf717ba7ee5e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:08,037 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676181788037"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181788037"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181788037"}]},"ts":"1676181788037"} 2023-02-12 06:03:08,039 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 403140db80c94e00c847bf717ba7ee5e, server=jenkins-hbase4.apache.org,34015,1676181786706}] 2023-02-12 06:03:08,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 06:03:08,192 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:08,192 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 06:03:08,194 INFO [RS-EventLoopGroup-11-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36712, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 06:03:08,197 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e. 2023-02-12 06:03:08,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 403140db80c94e00c847bf717ba7ee5e, NAME => 'testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e.', STARTKEY => '', ENDKEY => ''} 2023-02-12 06:03:08,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig 403140db80c94e00c847bf717ba7ee5e 2023-02-12 06:03:08,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:08,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 403140db80c94e00c847bf717ba7ee5e 2023-02-12 06:03:08,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 403140db80c94e00c847bf717ba7ee5e 2023-02-12 06:03:08,199 INFO [StoreOpener-403140db80c94e00c847bf717ba7ee5e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 403140db80c94e00c847bf717ba7ee5e 2023-02-12 06:03:08,200 DEBUG [StoreOpener-403140db80c94e00c847bf717ba7ee5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e/f1 2023-02-12 06:03:08,200 DEBUG [StoreOpener-403140db80c94e00c847bf717ba7ee5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e/f1 2023-02-12 06:03:08,200 INFO [StoreOpener-403140db80c94e00c847bf717ba7ee5e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 403140db80c94e00c847bf717ba7ee5e columnFamilyName f1 2023-02-12 06:03:08,201 INFO [StoreOpener-403140db80c94e00c847bf717ba7ee5e-1] regionserver.HStore(310): Store=403140db80c94e00c847bf717ba7ee5e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:08,201 INFO [StoreOpener-403140db80c94e00c847bf717ba7ee5e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 403140db80c94e00c847bf717ba7ee5e 2023-02-12 06:03:08,202 DEBUG [StoreOpener-403140db80c94e00c847bf717ba7ee5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e/f2 2023-02-12 06:03:08,202 DEBUG [StoreOpener-403140db80c94e00c847bf717ba7ee5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e/f2 2023-02-12 06:03:08,202 INFO [StoreOpener-403140db80c94e00c847bf717ba7ee5e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 403140db80c94e00c847bf717ba7ee5e columnFamilyName f2 2023-02-12 06:03:08,203 INFO [StoreOpener-403140db80c94e00c847bf717ba7ee5e-1] regionserver.HStore(310): Store=403140db80c94e00c847bf717ba7ee5e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:08,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e 2023-02-12 06:03:08,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e 2023-02-12 06:03:08,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:03:08,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 403140db80c94e00c847bf717ba7ee5e 2023-02-12 06:03:08,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:03:08,210 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 403140db80c94e00c847bf717ba7ee5e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74762177, jitterRate=0.11404325067996979}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:03:08,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 403140db80c94e00c847bf717ba7ee5e: Running coprocessor pre-open hook at 1676181788198Writing region info on filesystem at 1676181788198Initializing all the Stores at 1676181788198Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181788199 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181788199Cleaning up temporary data from old regions at 1676181788204 (+5 ms)Cleaning up detritus from prior splits at 1676181788205 (+1 ms)Running coprocessor post-open hooks at 1676181788210 (+5 ms)Region opened successfully at 1676181788210 2023-02-12 06:03:08,210 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e., pid=12, masterSystemTime=1676181788192 2023-02-12 06:03:08,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e. 2023-02-12 06:03:08,214 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e. 2023-02-12 06:03:08,214 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=403140db80c94e00c847bf717ba7ee5e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:08,214 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676181788214"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676181788214"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676181788214"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676181788214"}]},"ts":"1676181788214"} 2023-02-12 06:03:08,218 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-12 06:03:08,218 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 403140db80c94e00c847bf717ba7ee5e, server=jenkins-hbase4.apache.org,34015,1676181786706 in 177 msec 2023-02-12 06:03:08,219 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-12 06:03:08,219 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=403140db80c94e00c847bf717ba7ee5e, ASSIGN in 334 msec 2023-02-12 06:03:08,220 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 06:03:08,220 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676181788220"}]},"ts":"1676181788220"} 2023-02-12 06:03:08,221 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-12 06:03:08,224 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 06:03:08,225 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 378 msec 2023-02-12 06:03:08,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 06:03:08,455 INFO [Listener at localhost/33723] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-12 06:03:08,455 DEBUG [Listener at localhost/33723] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-12 06:03:08,456 INFO [Listener at localhost/33723] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 06:03:08,458 INFO [Listener at localhost/33723] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-12 06:03:08,458 INFO [Listener at localhost/33723] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 06:03:08,458 INFO [Listener at localhost/33723] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-12 06:03:08,458 INFO [Listener at localhost/33723] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-12 06:03:08,478 DEBUG [hconnection-0x3a6963a0-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 06:03:08,496 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36718, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 06:03:08,509 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34015] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e. 2023-02-12 06:03:08,610 INFO [Listener at localhost/33723] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-12 06:03:08,610 INFO [Listener at localhost/33723] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-12 06:03:08,611 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-12 06:03:08,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676181788611 (current time:1676181788611). 2023-02-12 06:03:08,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-12 06:03:08,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] zookeeper.ReadOnlyZKClient(139): Connect 0x398905c7 to 127.0.0.1:55171 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 06:03:08,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d370628, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 06:03:08,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 06:03:08,621 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44196, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 06:03:08,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x398905c7 to 127.0.0.1:55171 2023-02-12 06:03:08,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:08,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-12 06:03:08,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-12 06:03:08,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-12 06:03:08,625 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-12 06:03:08,626 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1676182388626 2023-02-12 06:03:08,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-12 06:03:08,626 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:08,627 DEBUG [Listener at localhost/33723] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-12 06:03:08,627 DEBUG [Listener at localhost/33723] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-12 06:03:08,628 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-12 06:03:08,628 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-12 06:03:08,629 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 4 msec 2023-02-12 06:03:08,629 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-12 06:03:08,630 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1676182388630 2023-02-12 06:03:08,644 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-12 06:03:08,645 INFO [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-12 06:03:08,645 DEBUG [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 06:03:08,646 DEBUG [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-12 06:03:08,646 DEBUG [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-12 06:03:08,725 DEBUG [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-12 06:03:08,725 DEBUG [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-12 06:03:08,727 DEBUG [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:08,727 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): regionserver:34015-0x100472039a20002, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 06:03:08,727 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): regionserver:46075-0x100472039a20001, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 06:03:08,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 06:03:08,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:03:08,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 06:03:08,727 DEBUG [Listener at localhost/33723] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 06:03:08,727 DEBUG [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:08,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:03:08,727 DEBUG [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 06:03:08,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-12 06:03:08,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-12 06:03:08,728 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34015-0x100472039a20002, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-12 06:03:08,728 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46075-0x100472039a20001, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-12 06:03:08,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-12 06:03:08,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-12 06:03:08,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-12 06:03:08,728 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-12 06:03:08,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-12 06:03:08,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-12 06:03:08,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-12 06:03:08,729 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-12 06:03:08,729 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-12 06:03:08,729 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-12 06:03:08,729 DEBUG [Listener at localhost/33723] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-12 06:03:08,729 DEBUG [member: 'jenkins-hbase4.apache.org,34015,1676181786706' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-12 06:03:08,729 DEBUG [member: 'jenkins-hbase4.apache.org,34015,1676181786706' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 06:03:08,729 DEBUG [member: 'jenkins-hbase4.apache.org,46075,1676181786668' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-12 06:03:08,730 DEBUG [member: 'jenkins-hbase4.apache.org,46075,1676181786668' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 06:03:08,730 DEBUG [member: 'jenkins-hbase4.apache.org,34015,1676181786706' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-12 06:03:08,730 DEBUG [member: 'jenkins-hbase4.apache.org,34015,1676181786706' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-12 06:03:08,731 DEBUG [member: 'jenkins-hbase4.apache.org,34015,1676181786706' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34015,1676181786706' joining acquired barrier for procedure (foo) in zk 2023-02-12 06:03:08,731 DEBUG [member: 'jenkins-hbase4.apache.org,46075,1676181786668' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-12 06:03:08,731 DEBUG [member: 'jenkins-hbase4.apache.org,46075,1676181786668' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-12 06:03:08,731 DEBUG [member: 'jenkins-hbase4.apache.org,46075,1676181786668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46075,1676181786668' joining acquired barrier for procedure (foo) in zk 2023-02-12 06:03:08,732 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:08,732 DEBUG [member: 'jenkins-hbase4.apache.org,34015,1676181786706' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-12 06:03:08,732 DEBUG [member: 'jenkins-hbase4.apache.org,46075,1676181786668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-12 06:03:08,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:08,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:08,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 06:03:08,732 DEBUG [member: 'jenkins-hbase4.apache.org,34015,1676181786706' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34015-0x100472039a20002, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-12 06:03:08,732 DEBUG [member: 'jenkins-hbase4.apache.org,34015,1676181786706' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 06:03:08,732 DEBUG [member: 'jenkins-hbase4.apache.org,46075,1676181786668' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46075-0x100472039a20001, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-12 06:03:08,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:08,733 DEBUG [member: 'jenkins-hbase4.apache.org,46075,1676181786668' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 06:03:08,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:08,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 06:03:08,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:08,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46075,1676181786668 2023-02-12 06:03:08,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:08,734 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34015,1676181786706' joining acquired barrier for procedure 'foo' on coordinator 2023-02-12 06:03:08,734 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38b86575[Count = 0] remaining members to acquire global barrier 2023-02-12 06:03:08,734 DEBUG [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-12 06:03:08,734 DEBUG [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-12 06:03:08,735 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): regionserver:34015-0x100472039a20002, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-12 06:03:08,735 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): regionserver:46075-0x100472039a20001, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-12 06:03:08,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-12 06:03:08,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-12 06:03:08,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-12 06:03:08,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-12 06:03:08,735 DEBUG [member: 'jenkins-hbase4.apache.org,46075,1676181786668' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-12 06:03:08,735 DEBUG [member: 'jenkins-hbase4.apache.org,34015,1676181786706' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-12 06:03:08,735 DEBUG [member: 'jenkins-hbase4.apache.org,46075,1676181786668' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-12 06:03:08,735 DEBUG [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:08,735 DEBUG [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 06:03:08,735 DEBUG [member: 'jenkins-hbase4.apache.org,46075,1676181786668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,46075,1676181786668' in zk 2023-02-12 06:03:08,736 DEBUG [member: 'jenkins-hbase4.apache.org,34015,1676181786706' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-12 06:03:08,736 DEBUG [member: 'jenkins-hbase4.apache.org,34015,1676181786706' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 06:03:08,736 DEBUG [rs(jenkins-hbase4.apache.org,34015,1676181786706)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e. 2023-02-12 06:03:08,736 DEBUG [rs(jenkins-hbase4.apache.org,34015,1676181786706)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e. started... 2023-02-12 06:03:08,736 INFO [rs(jenkins-hbase4.apache.org,34015,1676181786706)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 403140db80c94e00c847bf717ba7ee5e 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-12 06:03:08,737 DEBUG [member: 'jenkins-hbase4.apache.org,46075,1676181786668' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-12 06:03:08,737 DEBUG [member: 'jenkins-hbase4.apache.org,46075,1676181786668' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:03:08,738 DEBUG [member: 'jenkins-hbase4.apache.org,46075,1676181786668' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-12 06:03:08,752 INFO [rs(jenkins-hbase4.apache.org,34015,1676181786706)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e/.tmp/f1/693de14f68ab48bb92aceba8e71af7c0 2023-02-12 06:03:08,770 INFO [rs(jenkins-hbase4.apache.org,34015,1676181786706)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e/.tmp/f2/b550f657f9eb4f64a92d5c29071f5145 2023-02-12 06:03:08,774 DEBUG [rs(jenkins-hbase4.apache.org,34015,1676181786706)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e/.tmp/f1/693de14f68ab48bb92aceba8e71af7c0 as hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e/f1/693de14f68ab48bb92aceba8e71af7c0 2023-02-12 06:03:08,778 INFO [rs(jenkins-hbase4.apache.org,34015,1676181786706)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e/f1/693de14f68ab48bb92aceba8e71af7c0, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-12 06:03:08,779 DEBUG [rs(jenkins-hbase4.apache.org,34015,1676181786706)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e/.tmp/f2/b550f657f9eb4f64a92d5c29071f5145 as hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e/f2/b550f657f9eb4f64a92d5c29071f5145 2023-02-12 06:03:08,783 INFO [rs(jenkins-hbase4.apache.org,34015,1676181786706)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e/f2/b550f657f9eb4f64a92d5c29071f5145, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-12 06:03:08,784 INFO [rs(jenkins-hbase4.apache.org,34015,1676181786706)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 403140db80c94e00c847bf717ba7ee5e in 48ms, sequenceid=5, compaction requested=false 2023-02-12 06:03:08,784 DEBUG [rs(jenkins-hbase4.apache.org,34015,1676181786706)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-12 06:03:08,785 DEBUG [rs(jenkins-hbase4.apache.org,34015,1676181786706)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 403140db80c94e00c847bf717ba7ee5e: 2023-02-12 06:03:08,785 DEBUG [rs(jenkins-hbase4.apache.org,34015,1676181786706)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e.' region-info for snapshot=foo 2023-02-12 06:03:08,785 DEBUG [rs(jenkins-hbase4.apache.org,34015,1676181786706)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 06:03:08,785 DEBUG [rs(jenkins-hbase4.apache.org,34015,1676181786706)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e/f1/693de14f68ab48bb92aceba8e71af7c0] hfiles 2023-02-12 06:03:08,785 DEBUG [rs(jenkins-hbase4.apache.org,34015,1676181786706)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e/f1/693de14f68ab48bb92aceba8e71af7c0 for snapshot=foo 2023-02-12 06:03:08,785 DEBUG [rs(jenkins-hbase4.apache.org,34015,1676181786706)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e/f2/b550f657f9eb4f64a92d5c29071f5145] hfiles 2023-02-12 06:03:08,785 DEBUG [rs(jenkins-hbase4.apache.org,34015,1676181786706)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e/f2/b550f657f9eb4f64a92d5c29071f5145 for snapshot=foo 2023-02-12 06:03:08,795 DEBUG [rs(jenkins-hbase4.apache.org,34015,1676181786706)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e. completed. 2023-02-12 06:03:08,795 DEBUG [rs(jenkins-hbase4.apache.org,34015,1676181786706)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e. 2023-02-12 06:03:08,795 DEBUG [member: 'jenkins-hbase4.apache.org,34015,1676181786706' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-12 06:03:08,795 DEBUG [member: 'jenkins-hbase4.apache.org,34015,1676181786706' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-12 06:03:08,795 DEBUG [member: 'jenkins-hbase4.apache.org,34015,1676181786706' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:08,795 DEBUG [member: 'jenkins-hbase4.apache.org,34015,1676181786706' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-12 06:03:08,795 DEBUG [member: 'jenkins-hbase4.apache.org,34015,1676181786706' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,34015,1676181786706' in zk 2023-02-12 06:03:08,798 DEBUG [member: 'jenkins-hbase4.apache.org,34015,1676181786706' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-12 06:03:08,798 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:08,799 DEBUG [member: 'jenkins-hbase4.apache.org,34015,1676181786706' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:03:08,799 DEBUG [member: 'jenkins-hbase4.apache.org,34015,1676181786706' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-12 06:03:08,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:08,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:08,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 06:03:08,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:08,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:08,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 06:03:08,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:08,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46075,1676181786668 2023-02-12 06:03:08,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:08,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 06:03:08,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:08,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46075,1676181786668 2023-02-12 06:03:08,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,34015,1676181786706': 2023-02-12 06:03:08,803 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34015,1676181786706' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-12 06:03:08,803 INFO [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-12 06:03:08,803 DEBUG [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 06:03:08,803 DEBUG [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 06:03:08,803 DEBUG [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-12 06:03:08,803 INFO [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-12 06:03:08,805 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): regionserver:46075-0x100472039a20001, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-12 06:03:08,805 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): regionserver:34015-0x100472039a20002, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-12 06:03:08,805 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): regionserver:46075-0x100472039a20001, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 06:03:08,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-12 06:03:08,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-12 06:03:08,805 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): regionserver:34015-0x100472039a20002, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 06:03:08,805 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-12 06:03:08,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-12 06:03:08,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-12 06:03:08,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:08,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 06:03:08,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-12 06:03:08,805 DEBUG [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:08,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 06:03:08,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:03:08,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:08,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 06:03:08,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:03:08,806 DEBUG [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,46075,1676181786668 2023-02-12 06:03:08,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 06:03:08,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-12 06:03:08,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-12 06:03:08,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:08,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 06:03:08,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:08,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46075,1676181786668 2023-02-12 06:03:08,808 DEBUG [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:08,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:08,809 DEBUG [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,46075,1676181786668 2023-02-12 06:03:08,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 06:03:08,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:08,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46075,1676181786668 2023-02-12 06:03:08,815 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,46075,1676181786668 2023-02-12 06:03:08,815 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-12 06:03:08,815 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): regionserver:34015-0x100472039a20002, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 06:03:08,815 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:08,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 06:03:08,815 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-12 06:03:08,815 DEBUG [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:03:08,815 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): regionserver:34015-0x100472039a20002, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 06:03:08,815 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-12 06:03:08,815 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,46075,1676181786668 2023-02-12 06:03:08,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:03:08,816 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-12 06:03:08,816 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-12 06:03:08,816 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): regionserver:46075-0x100472039a20001, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 06:03:08,816 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:08,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 06:03:08,817 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-12 06:03:08,817 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): regionserver:46075-0x100472039a20001, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 06:03:08,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 06:03:08,817 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-12 06:03:08,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:03:08,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:03:08,817 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/.hbase-snapshot/.tmp/foo 2023-02-12 06:03:08,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 06:03:08,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:03:08,836 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/.hbase-snapshot/.tmp/foo to hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/.hbase-snapshot/foo 2023-02-12 06:03:08,855 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-12 06:03:08,855 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/.hbase-snapshot/.tmp/foo 2023-02-12 06:03:08,855 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/.hbase-snapshot/.tmp/foo 2023-02-12 06:03:08,855 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1676181788626Consolidate snapshot: foo at 1676181788816 (+190 ms)Loading Region manifests for foo at 1676181788817 (+1 ms)Writing data manifest for foo at 1676181788820 (+3 ms)Verifying snapshot: foo at 1676181788830 (+10 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1676181788855 (+25 ms) 2023-02-12 06:03:08,857 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-12 06:03:08,858 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 230 msec 2023-02-12 06:03:08,929 DEBUG [Listener at localhost/33723] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 06:03:08,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-12 06:03:08,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-12 06:03:08,931 INFO [Listener at localhost/33723] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-12 06:03:08,935 INFO [Listener at localhost/33723] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-12 06:03:08,940 INFO [Listener at localhost/33723] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-12 06:03:08,973 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34015] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e. 2023-02-12 06:03:09,056 INFO [Listener at localhost/33723] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-12 06:03:09,062 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-12 06:03:09,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,064 INFO [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-12 06:03:09,064 DEBUG [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 06:03:09,065 DEBUG [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-12 06:03:09,065 DEBUG [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-12 06:03:09,065 DEBUG [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,065 DEBUG [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,068 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): regionserver:34015-0x100472039a20002, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 06:03:09,068 DEBUG [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:09,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 06:03:09,068 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): regionserver:46075-0x100472039a20001, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 06:03:09,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:03:09,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 06:03:09,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:03:09,068 DEBUG [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:09,068 DEBUG [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 06:03:09,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,069 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34015-0x100472039a20002, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,069 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46075-0x100472039a20001, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 06:03:09,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,069 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 06:03:09,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,069 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,069 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,069 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,069 DEBUG [member: 'jenkins-hbase4.apache.org,34015,1676181786706' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-12 06:03:09,069 DEBUG [member: 'jenkins-hbase4.apache.org,34015,1676181786706' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 06:03:09,070 DEBUG [member: 'jenkins-hbase4.apache.org,46075,1676181786668' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-12 06:03:09,070 DEBUG [member: 'jenkins-hbase4.apache.org,46075,1676181786668' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 06:03:09,070 DEBUG [member: 'jenkins-hbase4.apache.org,34015,1676181786706' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-12 06:03:09,071 DEBUG [member: 'jenkins-hbase4.apache.org,46075,1676181786668' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-12 06:03:09,071 DEBUG [member: 'jenkins-hbase4.apache.org,46075,1676181786668' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-12 06:03:09,071 DEBUG [member: 'jenkins-hbase4.apache.org,46075,1676181786668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46075,1676181786668' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-12 06:03:09,071 DEBUG [member: 'jenkins-hbase4.apache.org,34015,1676181786706' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 06:03:09,071 DEBUG [member: 'jenkins-hbase4.apache.org,34015,1676181786706' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 06:03:09,071 DEBUG [rs(jenkins-hbase4.apache.org,34015,1676181786706)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e. 2023-02-12 06:03:09,071 DEBUG [rs(jenkins-hbase4.apache.org,34015,1676181786706)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e. started... 2023-02-12 06:03:09,071 INFO [rs(jenkins-hbase4.apache.org,34015,1676181786706)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 403140db80c94e00c847bf717ba7ee5e 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-12 06:03:09,073 DEBUG [member: 'jenkins-hbase4.apache.org,46075,1676181786668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,073 DEBUG [member: 'jenkins-hbase4.apache.org,46075,1676181786668' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46075-0x100472039a20001, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,073 DEBUG [member: 'jenkins-hbase4.apache.org,46075,1676181786668' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 06:03:09,088 INFO [rs(jenkins-hbase4.apache.org,34015,1676181786706)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e/.tmp/f1/d2b923ab59f9487aac15945ff91734e3 2023-02-12 06:03:09,109 INFO [rs(jenkins-hbase4.apache.org,34015,1676181786706)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e/.tmp/f2/af6e457365ed45c9991b54e3fc4ef62c 2023-02-12 06:03:09,114 DEBUG [rs(jenkins-hbase4.apache.org,34015,1676181786706)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e/.tmp/f1/d2b923ab59f9487aac15945ff91734e3 as hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e/f1/d2b923ab59f9487aac15945ff91734e3 2023-02-12 06:03:09,118 INFO [rs(jenkins-hbase4.apache.org,34015,1676181786706)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e/f1/d2b923ab59f9487aac15945ff91734e3, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-12 06:03:09,119 DEBUG [rs(jenkins-hbase4.apache.org,34015,1676181786706)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e/.tmp/f2/af6e457365ed45c9991b54e3fc4ef62c as hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e/f2/af6e457365ed45c9991b54e3fc4ef62c 2023-02-12 06:03:09,123 INFO [rs(jenkins-hbase4.apache.org,34015,1676181786706)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e/f2/af6e457365ed45c9991b54e3fc4ef62c, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-12 06:03:09,124 INFO [rs(jenkins-hbase4.apache.org,34015,1676181786706)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 403140db80c94e00c847bf717ba7ee5e in 53ms, sequenceid=9, compaction requested=false 2023-02-12 06:03:09,124 DEBUG [rs(jenkins-hbase4.apache.org,34015,1676181786706)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 403140db80c94e00c847bf717ba7ee5e: 2023-02-12 06:03:09,125 DEBUG [rs(jenkins-hbase4.apache.org,34015,1676181786706)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e. 2023-02-12 06:03:09,125 DEBUG [member: 'jenkins-hbase4.apache.org,34015,1676181786706' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 06:03:09,125 DEBUG [member: 'jenkins-hbase4.apache.org,34015,1676181786706' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 06:03:09,125 DEBUG [member: 'jenkins-hbase4.apache.org,34015,1676181786706' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:09,125 DEBUG [member: 'jenkins-hbase4.apache.org,34015,1676181786706' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-12 06:03:09,125 DEBUG [member: 'jenkins-hbase4.apache.org,34015,1676181786706' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34015,1676181786706' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-12 06:03:09,126 DEBUG [member: 'jenkins-hbase4.apache.org,34015,1676181786706' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,126 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:09,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:09,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:09,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 06:03:09,127 DEBUG [member: 'jenkins-hbase4.apache.org,34015,1676181786706' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34015-0x100472039a20002, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,127 DEBUG [member: 'jenkins-hbase4.apache.org,34015,1676181786706' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 06:03:09,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:09,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:09,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:09,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46075,1676181786668 2023-02-12 06:03:09,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:09,128 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34015,1676181786706' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-12 06:03:09,128 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c87e6ba[Count = 0] remaining members to acquire global barrier 2023-02-12 06:03:09,128 DEBUG [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-12 06:03:09,128 DEBUG [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,130 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): regionserver:46075-0x100472039a20001, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,130 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): regionserver:34015-0x100472039a20002, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,130 DEBUG [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:09,130 DEBUG [member: 'jenkins-hbase4.apache.org,46075,1676181786668' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-12 06:03:09,130 DEBUG [member: 'jenkins-hbase4.apache.org,46075,1676181786668' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-12 06:03:09,130 DEBUG [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 06:03:09,130 DEBUG [member: 'jenkins-hbase4.apache.org,34015,1676181786706' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-12 06:03:09,130 DEBUG [member: 'jenkins-hbase4.apache.org,34015,1676181786706' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-12 06:03:09,130 DEBUG [member: 'jenkins-hbase4.apache.org,46075,1676181786668' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,46075,1676181786668' in zk 2023-02-12 06:03:09,130 DEBUG [member: 'jenkins-hbase4.apache.org,34015,1676181786706' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,34015,1676181786706' in zk 2023-02-12 06:03:09,132 DEBUG [member: 'jenkins-hbase4.apache.org,46075,1676181786668' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-12 06:03:09,132 DEBUG [member: 'jenkins-hbase4.apache.org,46075,1676181786668' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:03:09,132 DEBUG [member: 'jenkins-hbase4.apache.org,46075,1676181786668' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-12 06:03:09,133 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:09,133 DEBUG [member: 'jenkins-hbase4.apache.org,34015,1676181786706' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-12 06:03:09,133 DEBUG [member: 'jenkins-hbase4.apache.org,34015,1676181786706' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:03:09,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:09,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:09,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 06:03:09,133 DEBUG [member: 'jenkins-hbase4.apache.org,34015,1676181786706' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-12 06:03:09,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:09,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:09,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:09,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46075,1676181786668 2023-02-12 06:03:09,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:09,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:09,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46075,1676181786668 2023-02-12 06:03:09,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase4.apache.org,34015,1676181786706': 2023-02-12 06:03:09,137 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34015,1676181786706' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-12 06:03:09,137 INFO [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-12 06:03:09,137 DEBUG [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 06:03:09,137 DEBUG [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 06:03:09,137 DEBUG [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,137 INFO [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 06:03:09,139 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): regionserver:34015-0x100472039a20002, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,139 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): regionserver:46075-0x100472039a20001, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,139 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,139 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): regionserver:46075-0x100472039a20001, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 06:03:09,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:09,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 06:03:09,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,139 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): regionserver:34015-0x100472039a20002, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 06:03:09,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 06:03:09,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:03:09,139 DEBUG [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:09,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:09,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 06:03:09,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:03:09,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,140 DEBUG [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46075,1676181786668 2023-02-12 06:03:09,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:09,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:09,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46075,1676181786668 2023-02-12 06:03:09,141 DEBUG [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:09,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:09,142 DEBUG [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46075,1676181786668 2023-02-12 06:03:09,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:09,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46075,1676181786668 2023-02-12 06:03:09,144 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46075,1676181786668 2023-02-12 06:03:09,144 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): regionserver:34015-0x100472039a20002, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 06:03:09,144 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,144 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): regionserver:34015-0x100472039a20002, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 06:03:09,144 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:09,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 06:03:09,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:03:09,144 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): regionserver:46075-0x100472039a20001, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 06:03:09,144 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 06:03:09,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:03:09,145 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,46075,1676181786668 2023-02-12 06:03:09,145 DEBUG [(jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:03:09,144 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): regionserver:46075-0x100472039a20001, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 06:03:09,145 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,145 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-12 06:03:09,146 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 06:03:09,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 06:03:09,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:03:09,145 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:09,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 06:03:09,146 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,146 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,146 DEBUG [Listener at localhost/33723] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-12 06:03:09,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:03:09,146 DEBUG [Listener at localhost/33723] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 06:03:09,246 DEBUG [Listener at localhost/33723] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 06:03:09,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 06:03:09,253 INFO [Listener at localhost/33723] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676181788611 type: FLUSH version: 2 ttl: 0 2023-02-12 06:03:09,253 DEBUG [Listener at localhost/33723] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:36613/user/jenkins/test-data/630b93c3-55d6-9f06-fe4e-f4dea26977f0/foo/34bfae85-8b50-4f1c-a201-24e4f9cca4f5/data/default/testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,253 INFO [Listener at localhost/33723] snapshot.RestoreSnapshotHelper(239): region to add: 403140db80c94e00c847bf717ba7ee5e 2023-02-12 06:03:09,254 INFO [Listener at localhost/33723] snapshot.RestoreSnapshotHelper(585): clone region=403140db80c94e00c847bf717ba7ee5e as 403140db80c94e00c847bf717ba7ee5e in snapshot foo 2023-02-12 06:03:09,254 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 403140db80c94e00c847bf717ba7ee5e, NAME => 'testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36613/user/jenkins/test-data/630b93c3-55d6-9f06-fe4e-f4dea26977f0/foo/34bfae85-8b50-4f1c-a201-24e4f9cca4f5 2023-02-12 06:03:09,261 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:09,261 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 693de14f68ab48bb92aceba8e71af7c0 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,263 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b550f657f9eb4f64a92d5c29071f5145 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,265 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 403140db80c94e00c847bf717ba7ee5e, disabling compactions & flushes 2023-02-12 06:03:09,265 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e. 2023-02-12 06:03:09,265 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e. 2023-02-12 06:03:09,265 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e. after waiting 0 ms 2023-02-12 06:03:09,265 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e. 2023-02-12 06:03:09,265 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e. 2023-02-12 06:03:09,265 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 403140db80c94e00c847bf717ba7ee5e: Waiting for close lock at 1676181789265Disabling compacts and flushes for region at 1676181789265Disabling writes for close at 1676181789265Writing region close event to WAL at 1676181789265Closed at 1676181789265 2023-02-12 06:03:09,265 INFO [Listener at localhost/33723] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676181788611 type: FLUSH version: 2 ttl: 0 2023-02-12 06:03:09,265 DEBUG [Listener at localhost/33723] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:36613/user/jenkins/test-data/630b93c3-55d6-9f06-fe4e-f4dea26977f0/foo/34bfae85-8b50-4f1c-a201-24e4f9cca4f5 2023-02-12 06:03:09,265 DEBUG [Listener at localhost/33723] util.CommonFSUtils(682): File system contents for path hdfs://localhost:36613/user/jenkins/test-data/630b93c3-55d6-9f06-fe4e-f4dea26977f0/foo/34bfae85-8b50-4f1c-a201-24e4f9cca4f5 2023-02-12 06:03:09,266 DEBUG [Listener at localhost/33723] util.CommonFSUtils(699): |-data/ 2023-02-12 06:03:09,266 DEBUG [Listener at localhost/33723] util.CommonFSUtils(699): |----default/ 2023-02-12 06:03:09,267 DEBUG [Listener at localhost/33723] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-12 06:03:09,267 DEBUG [Listener at localhost/33723] util.CommonFSUtils(699): |----------403140db80c94e00c847bf717ba7ee5e/ 2023-02-12 06:03:09,268 DEBUG [Listener at localhost/33723] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 06:03:09,268 DEBUG [Listener at localhost/33723] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 06:03:09,268 DEBUG [Listener at localhost/33723] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=403140db80c94e00c847bf717ba7ee5e-693de14f68ab48bb92aceba8e71af7c0 2023-02-12 06:03:09,269 DEBUG [Listener at localhost/33723] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 06:03:09,269 DEBUG [Listener at localhost/33723] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=403140db80c94e00c847bf717ba7ee5e-b550f657f9eb4f64a92d5c29071f5145 2023-02-12 06:03:09,270 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-12 06:03:09,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-12 06:03:09,273 INFO [Listener at localhost/33723] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,274 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,277 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676181789277"}]},"ts":"1676181789277"} 2023-02-12 06:03:09,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 06:03:09,278 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-12 06:03:09,281 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-12 06:03:09,282 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=403140db80c94e00c847bf717ba7ee5e, UNASSIGN}] 2023-02-12 06:03:09,283 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=403140db80c94e00c847bf717ba7ee5e, UNASSIGN 2023-02-12 06:03:09,284 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=403140db80c94e00c847bf717ba7ee5e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:09,284 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676181789284"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181789284"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181789284"}]},"ts":"1676181789284"} 2023-02-12 06:03:09,285 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 403140db80c94e00c847bf717ba7ee5e, server=jenkins-hbase4.apache.org,34015,1676181786706}] 2023-02-12 06:03:09,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 06:03:09,437 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 403140db80c94e00c847bf717ba7ee5e 2023-02-12 06:03:09,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 403140db80c94e00c847bf717ba7ee5e, disabling compactions & flushes 2023-02-12 06:03:09,438 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e. 2023-02-12 06:03:09,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e. 2023-02-12 06:03:09,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e. after waiting 0 ms 2023-02-12 06:03:09,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e. 2023-02-12 06:03:09,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 06:03:09,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e. 2023-02-12 06:03:09,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 403140db80c94e00c847bf717ba7ee5e: Waiting for close lock at 1676181789438Running coprocessor pre-close hooks at 1676181789438Disabling compacts and flushes for region at 1676181789438Disabling writes for close at 1676181789438Writing region close event to WAL at 1676181789439 (+1 ms)Running coprocessor post-close hooks at 1676181789442 (+3 ms)Closed at 1676181789442 2023-02-12 06:03:09,444 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 403140db80c94e00c847bf717ba7ee5e 2023-02-12 06:03:09,444 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=403140db80c94e00c847bf717ba7ee5e, regionState=CLOSED 2023-02-12 06:03:09,444 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676181789444"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181789444"}]},"ts":"1676181789444"} 2023-02-12 06:03:09,447 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-12 06:03:09,447 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 403140db80c94e00c847bf717ba7ee5e, server=jenkins-hbase4.apache.org,34015,1676181786706 in 161 msec 2023-02-12 06:03:09,448 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-12 06:03:09,448 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=403140db80c94e00c847bf717ba7ee5e, UNASSIGN in 165 msec 2023-02-12 06:03:09,449 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676181789449"}]},"ts":"1676181789449"} 2023-02-12 06:03:09,450 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-12 06:03:09,451 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-12 06:03:09,453 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 178 msec 2023-02-12 06:03:09,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 06:03:09,581 INFO [Listener at localhost/33723] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-12 06:03:09,582 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,584 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,585 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-12 06:03:09,588 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/.tmp/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e 2023-02-12 06:03:09,590 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/.tmp/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e/f1, FileablePath, hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/.tmp/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e/f2, FileablePath, hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/.tmp/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e/recovered.edits] 2023-02-12 06:03:09,593 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/.tmp/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e/f1/693de14f68ab48bb92aceba8e71af7c0 to hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/archive/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e/f1/693de14f68ab48bb92aceba8e71af7c0 2023-02-12 06:03:09,594 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/.tmp/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e/f1/d2b923ab59f9487aac15945ff91734e3 to hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/archive/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e/f1/d2b923ab59f9487aac15945ff91734e3 2023-02-12 06:03:09,596 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/.tmp/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e/f2/af6e457365ed45c9991b54e3fc4ef62c to hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/archive/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e/f2/af6e457365ed45c9991b54e3fc4ef62c 2023-02-12 06:03:09,597 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/.tmp/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e/f2/b550f657f9eb4f64a92d5c29071f5145 to hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/archive/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e/f2/b550f657f9eb4f64a92d5c29071f5145 2023-02-12 06:03:09,600 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/.tmp/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e/recovered.edits/12.seqid to hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/archive/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e/recovered.edits/12.seqid 2023-02-12 06:03:09,600 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/.tmp/data/default/testInitTableSnapshotMapperJobConfig/403140db80c94e00c847bf717ba7ee5e 2023-02-12 06:03:09,600 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-12 06:03:09,602 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,604 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-12 06:03:09,605 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-12 06:03:09,606 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,606 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-12 06:03:09,606 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676181789606"}]},"ts":"9223372036854775807"} 2023-02-12 06:03:09,608 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-12 06:03:09,608 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 403140db80c94e00c847bf717ba7ee5e, NAME => 'testInitTableSnapshotMapperJobConfig,,1676181787846.403140db80c94e00c847bf717ba7ee5e.', STARTKEY => '', ENDKEY => ''}] 2023-02-12 06:03:09,608 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-12 06:03:09,608 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676181789608"}]},"ts":"9223372036854775807"} 2023-02-12 06:03:09,611 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-12 06:03:09,613 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-12 06:03:09,614 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 31 msec 2023-02-12 06:03:09,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42497] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-12 06:03:09,687 INFO [Listener at localhost/33723] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-12 06:03:09,687 INFO [Listener at localhost/33723] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-12 06:03:09,687 INFO [Listener at localhost/33723] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 06:03:09,687 DEBUG [Listener at localhost/33723] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x061cb79f to 127.0.0.1:55171 2023-02-12 06:03:09,688 DEBUG [Listener at localhost/33723] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:09,688 DEBUG [Listener at localhost/33723] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-12 06:03:09,688 DEBUG [Listener at localhost/33723] util.JVMClusterUtil(257): Found active master hash=1007882792, stopped=false 2023-02-12 06:03:09,688 INFO [Listener at localhost/33723] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,42497,1676181786607 2023-02-12 06:03:09,691 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): regionserver:46075-0x100472039a20001, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 06:03:09,691 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 06:03:09,691 INFO [Listener at localhost/33723] procedure2.ProcedureExecutor(629): Stopping 2023-02-12 06:03:09,691 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:09,691 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): regionserver:34015-0x100472039a20002, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 06:03:09,691 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46075-0x100472039a20001, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:03:09,692 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34015-0x100472039a20002, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:03:09,692 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:03:09,692 DEBUG [Listener at localhost/33723] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c36470d to 127.0.0.1:55171 2023-02-12 06:03:09,693 DEBUG [Listener at localhost/33723] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:09,693 INFO [Listener at localhost/33723] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,46075,1676181786668' ***** 2023-02-12 06:03:09,693 INFO [Listener at localhost/33723] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 06:03:09,693 INFO [Listener at localhost/33723] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,34015,1676181786706' ***** 2023-02-12 06:03:09,693 INFO [Listener at localhost/33723] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 06:03:09,693 INFO [RS:0;jenkins-hbase4:46075] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 06:03:09,693 INFO [RS:0;jenkins-hbase4:46075] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 06:03:09,694 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 06:03:09,694 INFO [RS:0;jenkins-hbase4:46075] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 06:03:09,695 INFO [RS:0;jenkins-hbase4:46075] regionserver.HRegionServer(3304): Received CLOSE for a7e7a28af6137484561bbdada3875902 2023-02-12 06:03:09,695 INFO [RS:1;jenkins-hbase4:34015] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 06:03:09,695 INFO [RS:0;jenkins-hbase4:46075] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,46075,1676181786668 2023-02-12 06:03:09,695 DEBUG [RS:0;jenkins-hbase4:46075] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x18aa2cfb to 127.0.0.1:55171 2023-02-12 06:03:09,695 DEBUG [RS:0;jenkins-hbase4:46075] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:09,696 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 06:03:09,696 INFO [RS:1;jenkins-hbase4:34015] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 06:03:09,696 INFO [RS:1;jenkins-hbase4:34015] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 06:03:09,696 INFO [RS:0;jenkins-hbase4:46075] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 06:03:09,696 INFO [RS:1;jenkins-hbase4:34015] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:09,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing a7e7a28af6137484561bbdada3875902, disabling compactions & flushes 2023-02-12 06:03:09,696 INFO [RS:0;jenkins-hbase4:46075] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 06:03:09,697 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676181787296.a7e7a28af6137484561bbdada3875902. 2023-02-12 06:03:09,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676181787296.a7e7a28af6137484561bbdada3875902. 2023-02-12 06:03:09,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676181787296.a7e7a28af6137484561bbdada3875902. after waiting 0 ms 2023-02-12 06:03:09,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676181787296.a7e7a28af6137484561bbdada3875902. 2023-02-12 06:03:09,697 DEBUG [RS:1;jenkins-hbase4:34015] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58312236 to 127.0.0.1:55171 2023-02-12 06:03:09,697 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing a7e7a28af6137484561bbdada3875902 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-12 06:03:09,697 INFO [RS:0;jenkins-hbase4:46075] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 06:03:09,697 INFO [RS:0;jenkins-hbase4:46075] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-12 06:03:09,697 DEBUG [RS:1;jenkins-hbase4:34015] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:09,697 INFO [RS:1;jenkins-hbase4:34015] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,34015,1676181786706; all regions closed. 2023-02-12 06:03:09,697 INFO [RS:0;jenkins-hbase4:46075] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-12 06:03:09,698 DEBUG [RS:0;jenkins-hbase4:46075] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, a7e7a28af6137484561bbdada3875902=hbase:namespace,,1676181787296.a7e7a28af6137484561bbdada3875902.} 2023-02-12 06:03:09,698 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 06:03:09,698 DEBUG [RS:0;jenkins-hbase4:46075] regionserver.HRegionServer(1505): Waiting on 1588230740, a7e7a28af6137484561bbdada3875902 2023-02-12 06:03:09,698 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 06:03:09,698 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 06:03:09,698 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 06:03:09,698 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 06:03:09,698 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-12 06:03:09,704 DEBUG [RS:1;jenkins-hbase4:34015] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/oldWALs 2023-02-12 06:03:09,704 INFO [RS:1;jenkins-hbase4:34015] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34015%2C1676181786706:(num 1676181788008) 2023-02-12 06:03:09,704 DEBUG [RS:1;jenkins-hbase4:34015] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:09,704 INFO [RS:1;jenkins-hbase4:34015] regionserver.LeaseManager(133): Closed leases 2023-02-12 06:03:09,704 INFO [RS:1;jenkins-hbase4:34015] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-12 06:03:09,704 INFO [RS:1;jenkins-hbase4:34015] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 06:03:09,704 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 06:03:09,704 INFO [RS:1;jenkins-hbase4:34015] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 06:03:09,704 INFO [RS:1;jenkins-hbase4:34015] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 06:03:09,705 INFO [RS:1;jenkins-hbase4:34015] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34015 2023-02-12 06:03:09,707 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): regionserver:46075-0x100472039a20001, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:09,707 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 06:03:09,707 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): regionserver:46075-0x100472039a20001, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 06:03:09,707 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): regionserver:34015-0x100472039a20002, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34015,1676181786706 2023-02-12 06:03:09,708 ERROR [Listener at localhost/33723-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5c51295a rejected from java.util.concurrent.ThreadPoolExecutor@586ea608[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:09,708 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): regionserver:34015-0x100472039a20002, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 06:03:09,708 ERROR [Listener at localhost/33723-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@79f5d0b9 rejected from java.util.concurrent.ThreadPoolExecutor@586ea608[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:09,708 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34015,1676181786706] 2023-02-12 06:03:09,708 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34015,1676181786706; numProcessing=1 2023-02-12 06:03:09,709 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34015,1676181786706 already deleted, retry=false 2023-02-12 06:03:09,709 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34015,1676181786706 expired; onlineServers=1 2023-02-12 06:03:09,724 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/hbase/namespace/a7e7a28af6137484561bbdada3875902/.tmp/info/01568f1312fb4c6db976e058deefedd0 2023-02-12 06:03:09,728 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/hbase/meta/1588230740/.tmp/info/9e1b556371a54aa7becde53e66b04b86 2023-02-12 06:03:09,733 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9e1b556371a54aa7becde53e66b04b86 2023-02-12 06:03:09,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/hbase/namespace/a7e7a28af6137484561bbdada3875902/.tmp/info/01568f1312fb4c6db976e058deefedd0 as hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/hbase/namespace/a7e7a28af6137484561bbdada3875902/info/01568f1312fb4c6db976e058deefedd0 2023-02-12 06:03:09,738 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/hbase/namespace/a7e7a28af6137484561bbdada3875902/info/01568f1312fb4c6db976e058deefedd0, entries=2, sequenceid=6, filesize=4.8 K 2023-02-12 06:03:09,739 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for a7e7a28af6137484561bbdada3875902 in 42ms, sequenceid=6, compaction requested=false 2023-02-12 06:03:09,751 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/hbase/meta/1588230740/.tmp/rep_barrier/358939a50bf847a082b24a861eb70606 2023-02-12 06:03:09,751 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/hbase/namespace/a7e7a28af6137484561bbdada3875902/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-12 06:03:09,752 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676181787296.a7e7a28af6137484561bbdada3875902. 2023-02-12 06:03:09,752 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for a7e7a28af6137484561bbdada3875902: Waiting for close lock at 1676181789696Running coprocessor pre-close hooks at 1676181789696Disabling compacts and flushes for region at 1676181789696Disabling writes for close at 1676181789697 (+1 ms)Obtaining lock to block concurrent updates at 1676181789697Preparing flush snapshotting stores in a7e7a28af6137484561bbdada3875902 at 1676181789697Finished memstore snapshotting hbase:namespace,,1676181787296.a7e7a28af6137484561bbdada3875902., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676181789697Flushing stores of hbase:namespace,,1676181787296.a7e7a28af6137484561bbdada3875902. at 1676181789698 (+1 ms)Flushing a7e7a28af6137484561bbdada3875902/info: creating writer at 1676181789698Flushing a7e7a28af6137484561bbdada3875902/info: appending metadata at 1676181789702 (+4 ms)Flushing a7e7a28af6137484561bbdada3875902/info: closing flushed file at 1676181789702Flushing a7e7a28af6137484561bbdada3875902/info: reopening flushed file at 1676181789733 (+31 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for a7e7a28af6137484561bbdada3875902 in 42ms, sequenceid=6, compaction requested=false at 1676181789739 (+6 ms)Writing region close event to WAL at 1676181789748 (+9 ms)Running coprocessor post-close hooks at 1676181789752 (+4 ms)Closed at 1676181789752 2023-02-12 06:03:09,752 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676181787296.a7e7a28af6137484561bbdada3875902. 2023-02-12 06:03:09,755 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 358939a50bf847a082b24a861eb70606 2023-02-12 06:03:09,767 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/hbase/meta/1588230740/.tmp/table/d34fb7c0e0584e72a1ef4b45af2bf7bd 2023-02-12 06:03:09,771 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d34fb7c0e0584e72a1ef4b45af2bf7bd 2023-02-12 06:03:09,772 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/hbase/meta/1588230740/.tmp/info/9e1b556371a54aa7becde53e66b04b86 as hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/hbase/meta/1588230740/info/9e1b556371a54aa7becde53e66b04b86 2023-02-12 06:03:09,776 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9e1b556371a54aa7becde53e66b04b86 2023-02-12 06:03:09,776 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/hbase/meta/1588230740/info/9e1b556371a54aa7becde53e66b04b86, entries=12, sequenceid=21, filesize=6.3 K 2023-02-12 06:03:09,777 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/hbase/meta/1588230740/.tmp/rep_barrier/358939a50bf847a082b24a861eb70606 as hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/hbase/meta/1588230740/rep_barrier/358939a50bf847a082b24a861eb70606 2023-02-12 06:03:09,782 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 358939a50bf847a082b24a861eb70606 2023-02-12 06:03:09,782 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/hbase/meta/1588230740/rep_barrier/358939a50bf847a082b24a861eb70606, entries=1, sequenceid=21, filesize=5.0 K 2023-02-12 06:03:09,782 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 06:03:09,782 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 06:03:09,784 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/hbase/meta/1588230740/.tmp/table/d34fb7c0e0584e72a1ef4b45af2bf7bd as hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/hbase/meta/1588230740/table/d34fb7c0e0584e72a1ef4b45af2bf7bd 2023-02-12 06:03:09,788 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d34fb7c0e0584e72a1ef4b45af2bf7bd 2023-02-12 06:03:09,788 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/hbase/meta/1588230740/table/d34fb7c0e0584e72a1ef4b45af2bf7bd, entries=4, sequenceid=21, filesize=5.1 K 2023-02-12 06:03:09,789 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 91ms, sequenceid=21, compaction requested=false 2023-02-12 06:03:09,793 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-12 06:03:09,794 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 06:03:09,794 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 06:03:09,794 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676181789698Running coprocessor pre-close hooks at 1676181789698Disabling compacts and flushes for region at 1676181789698Disabling writes for close at 1676181789698Obtaining lock to block concurrent updates at 1676181789699 (+1 ms)Preparing flush snapshotting stores in 1588230740 at 1676181789699Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4340, getHeapSize=7776, getOffHeapSize=0, getCellsCount=36 at 1676181789699Flushing stores of hbase:meta,,1.1588230740 at 1676181789699Flushing 1588230740/info: creating writer at 1676181789699Flushing 1588230740/info: appending metadata at 1676181789703 (+4 ms)Flushing 1588230740/info: closing flushed file at 1676181789703Flushing 1588230740/rep_barrier: creating writer at 1676181789733 (+30 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676181789735 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676181789735Flushing 1588230740/table: creating writer at 1676181789755 (+20 ms)Flushing 1588230740/table: appending metadata at 1676181789757 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676181789757Flushing 1588230740/info: reopening flushed file at 1676181789772 (+15 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676181789777 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1676181789784 (+7 ms)Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 91ms, sequenceid=21, compaction requested=false at 1676181789789 (+5 ms)Writing region close event to WAL at 1676181789791 (+2 ms)Running coprocessor post-close hooks at 1676181789794 (+3 ms)Closed at 1676181789794 2023-02-12 06:03:09,794 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-12 06:03:09,838 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 06:03:09,889 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): regionserver:34015-0x100472039a20002, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:03:09,889 INFO [RS:1;jenkins-hbase4:34015] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,34015,1676181786706; zookeeper connection closed. 2023-02-12 06:03:09,889 ERROR [Listener at localhost/33723-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@148904d rejected from java.util.concurrent.ThreadPoolExecutor@586ea608[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:09,890 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): regionserver:34015-0x100472039a20002, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:03:09,890 ERROR [Listener at localhost/33723-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2ae4ab27 rejected from java.util.concurrent.ThreadPoolExecutor@586ea608[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:09,890 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6a5d0b86] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6a5d0b86 2023-02-12 06:03:09,898 INFO [RS:0;jenkins-hbase4:46075] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,46075,1676181786668; all regions closed. 2023-02-12 06:03:09,903 DEBUG [RS:0;jenkins-hbase4:46075] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/oldWALs 2023-02-12 06:03:09,903 INFO [RS:0;jenkins-hbase4:46075] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46075%2C1676181786668.meta:.meta(num 1676181787236) 2023-02-12 06:03:09,907 DEBUG [RS:0;jenkins-hbase4:46075] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/oldWALs 2023-02-12 06:03:09,907 INFO [RS:0;jenkins-hbase4:46075] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46075%2C1676181786668:(num 1676181787645) 2023-02-12 06:03:09,907 DEBUG [RS:0;jenkins-hbase4:46075] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:09,908 INFO [RS:0;jenkins-hbase4:46075] regionserver.LeaseManager(133): Closed leases 2023-02-12 06:03:09,908 INFO [RS:0;jenkins-hbase4:46075] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-12 06:03:09,908 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 06:03:09,909 INFO [RS:0;jenkins-hbase4:46075] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46075 2023-02-12 06:03:09,910 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): regionserver:46075-0x100472039a20001, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46075,1676181786668 2023-02-12 06:03:09,910 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 06:03:09,910 ERROR [Listener at localhost/33723-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1307087b rejected from java.util.concurrent.ThreadPoolExecutor@17389ec3[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:09,912 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46075,1676181786668] 2023-02-12 06:03:09,912 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46075,1676181786668; numProcessing=2 2023-02-12 06:03:09,913 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46075,1676181786668 already deleted, retry=false 2023-02-12 06:03:09,913 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46075,1676181786668 expired; onlineServers=0 2023-02-12 06:03:09,913 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,42497,1676181786607' ***** 2023-02-12 06:03:09,913 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-12 06:03:09,913 DEBUG [M:0;jenkins-hbase4:42497] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@382c9172, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 06:03:09,913 INFO [M:0;jenkins-hbase4:42497] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,42497,1676181786607 2023-02-12 06:03:09,913 INFO [M:0;jenkins-hbase4:42497] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,42497,1676181786607; all regions closed. 2023-02-12 06:03:09,913 DEBUG [M:0;jenkins-hbase4:42497] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:09,914 DEBUG [M:0;jenkins-hbase4:42497] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-12 06:03:09,914 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-12 06:03:09,914 DEBUG [M:0;jenkins-hbase4:42497] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-12 06:03:09,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676181786872] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676181786872,5,FailOnTimeoutGroup] 2023-02-12 06:03:09,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676181786872] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676181786872,5,FailOnTimeoutGroup] 2023-02-12 06:03:09,914 INFO [M:0;jenkins-hbase4:42497] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-12 06:03:09,915 INFO [M:0;jenkins-hbase4:42497] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-12 06:03:09,915 INFO [M:0;jenkins-hbase4:42497] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-12 06:03:09,915 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-12 06:03:09,915 DEBUG [M:0;jenkins-hbase4:42497] master.HMaster(1502): Stopping service threads 2023-02-12 06:03:09,915 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:09,915 INFO [M:0;jenkins-hbase4:42497] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-12 06:03:09,916 ERROR [M:0;jenkins-hbase4:42497] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-12 06:03:09,916 INFO [M:0;jenkins-hbase4:42497] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-12 06:03:09,916 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 06:03:09,916 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-12 06:03:09,916 DEBUG [M:0;jenkins-hbase4:42497] zookeeper.ZKUtil(398): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-12 06:03:09,916 WARN [M:0;jenkins-hbase4:42497] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-12 06:03:09,916 INFO [M:0;jenkins-hbase4:42497] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-12 06:03:09,917 INFO [M:0;jenkins-hbase4:42497] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-12 06:03:09,917 DEBUG [M:0;jenkins-hbase4:42497] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 06:03:09,917 INFO [M:0;jenkins-hbase4:42497] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:09,917 DEBUG [M:0;jenkins-hbase4:42497] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:09,917 DEBUG [M:0;jenkins-hbase4:42497] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 06:03:09,917 DEBUG [M:0;jenkins-hbase4:42497] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:09,917 INFO [M:0;jenkins-hbase4:42497] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.90 KB heapSize=66.84 KB 2023-02-12 06:03:09,926 INFO [M:0;jenkins-hbase4:42497] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.90 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a8df39445a6344fba0d114b0f0330ea5 2023-02-12 06:03:09,930 DEBUG [M:0;jenkins-hbase4:42497] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a8df39445a6344fba0d114b0f0330ea5 as hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a8df39445a6344fba0d114b0f0330ea5 2023-02-12 06:03:09,933 INFO [M:0;jenkins-hbase4:42497] regionserver.HStore(1080): Added hdfs://localhost:36613/user/jenkins/test-data/5d942069-4b69-c04f-fc34-cdc0af4bd9f6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a8df39445a6344fba0d114b0f0330ea5, entries=17, sequenceid=132, filesize=8.7 K 2023-02-12 06:03:09,934 INFO [M:0;jenkins-hbase4:42497] regionserver.HRegion(2947): Finished flush of dataSize ~55.90 KB/57240, heapSize ~66.82 KB/68424, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false 2023-02-12 06:03:09,934 INFO [M:0;jenkins-hbase4:42497] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:09,934 DEBUG [M:0;jenkins-hbase4:42497] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676181789917Disabling compacts and flushes for region at 1676181789917Disabling writes for close at 1676181789917Obtaining lock to block concurrent updates at 1676181789917Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676181789917Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57240, getHeapSize=68424, getOffHeapSize=0, getCellsCount=145 at 1676181789918 (+1 ms)Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676181789918Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676181789919 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676181789921 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676181789921Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676181789930 (+9 ms)Finished flush of dataSize ~55.90 KB/57240, heapSize ~66.82 KB/68424, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false at 1676181789934 (+4 ms)Writing region close event to WAL at 1676181789934Closed at 1676181789934 2023-02-12 06:03:09,937 INFO [M:0;jenkins-hbase4:42497] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-12 06:03:09,937 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 06:03:09,938 INFO [M:0;jenkins-hbase4:42497] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42497 2023-02-12 06:03:09,939 DEBUG [M:0;jenkins-hbase4:42497] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,42497,1676181786607 already deleted, retry=false 2023-02-12 06:03:10,290 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:03:10,290 INFO [M:0;jenkins-hbase4:42497] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,42497,1676181786607; zookeeper connection closed. 2023-02-12 06:03:10,290 ERROR [Listener at localhost/33723-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@78d76e83 rejected from java.util.concurrent.ThreadPoolExecutor@7ce8e541[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:10,291 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): master:42497-0x100472039a20000, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:03:10,291 ERROR [Listener at localhost/33723-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4bf904b2 rejected from java.util.concurrent.ThreadPoolExecutor@7ce8e541[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:10,391 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): regionserver:46075-0x100472039a20001, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:03:10,391 INFO [RS:0;jenkins-hbase4:46075] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,46075,1676181786668; zookeeper connection closed. 2023-02-12 06:03:10,391 ERROR [Listener at localhost/33723-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@484d18d9 rejected from java.util.concurrent.ThreadPoolExecutor@17389ec3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:10,391 DEBUG [Listener at localhost/33723-EventThread] zookeeper.ZKWatcher(600): regionserver:46075-0x100472039a20001, quorum=127.0.0.1:55171, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:03:10,391 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@31dd3f2f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@31dd3f2f 2023-02-12 06:03:10,391 ERROR [Listener at localhost/33723-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@303fd14a rejected from java.util.concurrent.ThreadPoolExecutor@17389ec3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:10,391 INFO [Listener at localhost/33723] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-12 06:03:10,391 WARN [Listener at localhost/33723] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 06:03:10,395 INFO [Listener at localhost/33723] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 06:03:10,499 WARN [BP-1057068857-172.31.14.131-1676181785212 heartbeating to localhost/127.0.0.1:36613] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 06:03:10,499 WARN [BP-1057068857-172.31.14.131-1676181785212 heartbeating to localhost/127.0.0.1:36613] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1057068857-172.31.14.131-1676181785212 (Datanode Uuid 91bd3116-13ef-4969-8035-ebadf996b88a) service to localhost/127.0.0.1:36613 2023-02-12 06:03:10,500 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/906c6c76-a3b0-b323-5f50-4be63b60505e/cluster_a58b861a-c9d3-0aa4-9566-754a9193b49c/dfs/data/data3/current/BP-1057068857-172.31.14.131-1676181785212] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 06:03:10,500 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/906c6c76-a3b0-b323-5f50-4be63b60505e/cluster_a58b861a-c9d3-0aa4-9566-754a9193b49c/dfs/data/data4/current/BP-1057068857-172.31.14.131-1676181785212] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 06:03:10,502 WARN [Listener at localhost/33723] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 06:03:10,505 INFO [Listener at localhost/33723] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 06:03:10,609 WARN [BP-1057068857-172.31.14.131-1676181785212 heartbeating to localhost/127.0.0.1:36613] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 06:03:10,609 WARN [BP-1057068857-172.31.14.131-1676181785212 heartbeating to localhost/127.0.0.1:36613] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1057068857-172.31.14.131-1676181785212 (Datanode Uuid e1d66959-5163-4f76-bad8-9473ca8739ad) service to localhost/127.0.0.1:36613 2023-02-12 06:03:10,610 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/906c6c76-a3b0-b323-5f50-4be63b60505e/cluster_a58b861a-c9d3-0aa4-9566-754a9193b49c/dfs/data/data1/current/BP-1057068857-172.31.14.131-1676181785212] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 06:03:10,610 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/906c6c76-a3b0-b323-5f50-4be63b60505e/cluster_a58b861a-c9d3-0aa4-9566-754a9193b49c/dfs/data/data2/current/BP-1057068857-172.31.14.131-1676181785212] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 06:03:10,624 INFO [Listener at localhost/33723] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 06:03:10,738 INFO [Listener at localhost/33723] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-12 06:03:10,768 INFO [Listener at localhost/33723] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-12 06:03:10,780 INFO [Listener at localhost/33723] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=180 (was 158) Potentially hanging thread: LeaseRenewer:jenkins@localhost:36613 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: (jenkins-hbase4.apache.org,42497,1676181786607)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:36613 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:36613 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost:36613 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost:36613 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33723 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:36613 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:36613 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=571 (was 545) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=321 (was 323), ProcessCount=166 (was 166), AvailableMemoryMB=4314 (was 4354) 2023-02-12 06:03:10,789 INFO [Listener at localhost/33723] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=180, OpenFileDescriptor=571, MaxFileDescriptor=60000, SystemLoadAverage=321, ProcessCount=166, AvailableMemoryMB=4314 2023-02-12 06:03:10,800 INFO [Listener at localhost/33723] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/906c6c76-a3b0-b323-5f50-4be63b60505e/hadoop.log.dir so I do NOT create it in target/test-data/4a2a4180-fc2e-d892-681d-2c4f0723a476 2023-02-12 06:03:10,801 WARN [Listener at localhost/33723] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/906c6c76-a3b0-b323-5f50-4be63b60505e/hadoop.log.dir Erasing configuration value by system value. 2023-02-12 06:03:10,801 INFO [Listener at localhost/33723] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/906c6c76-a3b0-b323-5f50-4be63b60505e/hadoop.tmp.dir so I do NOT create it in target/test-data/4a2a4180-fc2e-d892-681d-2c4f0723a476 2023-02-12 06:03:10,801 WARN [Listener at localhost/33723] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/906c6c76-a3b0-b323-5f50-4be63b60505e/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-12 06:03:10,801 DEBUG [Listener at localhost/33723] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a2a4180-fc2e-d892-681d-2c4f0723a476 2023-02-12 06:03:10,801 INFO [Listener at localhost/33723] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-12 06:03:10,801 INFO [Listener at localhost/33723] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a2a4180-fc2e-d892-681d-2c4f0723a476/cluster_f966ec53-e0ed-65ac-4846-e0b979a5b974, deleteOnExit=true 2023-02-12 06:03:10,801 INFO [Listener at localhost/33723] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-12 06:03:10,801 INFO [Listener at localhost/33723] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a2a4180-fc2e-d892-681d-2c4f0723a476/test.cache.data in system properties and HBase conf 2023-02-12 06:03:10,801 INFO [Listener at localhost/33723] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a2a4180-fc2e-d892-681d-2c4f0723a476/hadoop.tmp.dir in system properties and HBase conf 2023-02-12 06:03:10,801 INFO [Listener at localhost/33723] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a2a4180-fc2e-d892-681d-2c4f0723a476/hadoop.log.dir in system properties and HBase conf 2023-02-12 06:03:10,802 INFO [Listener at localhost/33723] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a2a4180-fc2e-d892-681d-2c4f0723a476/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-12 06:03:10,802 INFO [Listener at localhost/33723] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a2a4180-fc2e-d892-681d-2c4f0723a476/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-12 06:03:10,802 INFO [Listener at localhost/33723] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-12 06:03:10,802 DEBUG [Listener at localhost/33723] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-12 06:03:10,802 INFO [Listener at localhost/33723] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a2a4180-fc2e-d892-681d-2c4f0723a476/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-12 06:03:10,802 INFO [Listener at localhost/33723] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a2a4180-fc2e-d892-681d-2c4f0723a476/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-12 06:03:10,802 INFO [Listener at localhost/33723] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a2a4180-fc2e-d892-681d-2c4f0723a476/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-12 06:03:10,802 INFO [Listener at localhost/33723] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a2a4180-fc2e-d892-681d-2c4f0723a476/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 06:03:10,802 INFO [Listener at localhost/33723] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a2a4180-fc2e-d892-681d-2c4f0723a476/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-12 06:03:10,802 INFO [Listener at localhost/33723] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a2a4180-fc2e-d892-681d-2c4f0723a476/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-12 06:03:10,803 INFO [Listener at localhost/33723] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a2a4180-fc2e-d892-681d-2c4f0723a476/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 06:03:10,803 INFO [Listener at localhost/33723] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a2a4180-fc2e-d892-681d-2c4f0723a476/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 06:03:10,803 INFO [Listener at localhost/33723] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a2a4180-fc2e-d892-681d-2c4f0723a476/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-12 06:03:10,803 INFO [Listener at localhost/33723] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a2a4180-fc2e-d892-681d-2c4f0723a476/nfs.dump.dir in system properties and HBase conf 2023-02-12 06:03:10,803 INFO [Listener at localhost/33723] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a2a4180-fc2e-d892-681d-2c4f0723a476/java.io.tmpdir in system properties and HBase conf 2023-02-12 06:03:10,803 INFO [Listener at localhost/33723] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a2a4180-fc2e-d892-681d-2c4f0723a476/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 06:03:10,803 INFO [Listener at localhost/33723] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a2a4180-fc2e-d892-681d-2c4f0723a476/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-12 06:03:10,803 INFO [Listener at localhost/33723] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a2a4180-fc2e-d892-681d-2c4f0723a476/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-12 06:03:10,807 WARN [Listener at localhost/33723] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 06:03:10,808 WARN [Listener at localhost/33723] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 06:03:10,858 WARN [Listener at localhost/33723] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 06:03:10,861 INFO [Listener at localhost/33723] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 06:03:10,869 INFO [Listener at localhost/33723] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a2a4180-fc2e-d892-681d-2c4f0723a476/java.io.tmpdir/Jetty_localhost_37539_hdfs____.7v4f6n/webapp 2023-02-12 06:03:10,973 INFO [Listener at localhost/33723] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37539 2023-02-12 06:03:10,977 WARN [Listener at localhost/33723] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 06:03:10,977 WARN [Listener at localhost/33723] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 06:03:11,027 WARN [Listener at localhost/45441] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 06:03:11,044 WARN [Listener at localhost/45441] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 06:03:11,046 WARN [Listener at localhost/45441] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 06:03:11,047 INFO [Listener at localhost/45441] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 06:03:11,053 INFO [Listener at localhost/45441] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a2a4180-fc2e-d892-681d-2c4f0723a476/java.io.tmpdir/Jetty_localhost_37155_datanode____wkyrro/webapp 2023-02-12 06:03:11,150 INFO [Listener at localhost/45441] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37155 2023-02-12 06:03:11,160 WARN [Listener at localhost/36013] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 06:03:11,181 WARN [Listener at localhost/36013] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 06:03:11,183 WARN [Listener at localhost/36013] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 06:03:11,184 INFO [Listener at localhost/36013] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 06:03:11,192 INFO [Listener at localhost/36013] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a2a4180-fc2e-d892-681d-2c4f0723a476/java.io.tmpdir/Jetty_localhost_34357_datanode____r1h4aj/webapp 2023-02-12 06:03:11,273 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2b463d8c5d5e5a14: Processing first storage report for DS-613b7c0c-88f6-4bc9-b1d6-b508435f4f84 from datanode f55c5f93-1f5a-4d6a-ab9d-bd822f6004e9 2023-02-12 06:03:11,273 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2b463d8c5d5e5a14: from storage DS-613b7c0c-88f6-4bc9-b1d6-b508435f4f84 node DatanodeRegistration(127.0.0.1:45457, datanodeUuid=f55c5f93-1f5a-4d6a-ab9d-bd822f6004e9, infoPort=35367, infoSecurePort=0, ipcPort=36013, storageInfo=lv=-57;cid=testClusterID;nsid=870845555;c=1676181790810), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 06:03:11,273 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2b463d8c5d5e5a14: Processing first storage report for DS-ca28d63a-d144-424e-8bbd-880da7b0f079 from datanode f55c5f93-1f5a-4d6a-ab9d-bd822f6004e9 2023-02-12 06:03:11,273 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2b463d8c5d5e5a14: from storage DS-ca28d63a-d144-424e-8bbd-880da7b0f079 node DatanodeRegistration(127.0.0.1:45457, datanodeUuid=f55c5f93-1f5a-4d6a-ab9d-bd822f6004e9, infoPort=35367, infoSecurePort=0, ipcPort=36013, storageInfo=lv=-57;cid=testClusterID;nsid=870845555;c=1676181790810), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 06:03:11,291 INFO [Listener at localhost/36013] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34357 2023-02-12 06:03:11,299 WARN [Listener at localhost/46353] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 06:03:11,404 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb440c95b8245fcb9: Processing first storage report for DS-c9752502-7b5d-4e92-a822-302cb1ec81d7 from datanode d10e44f1-738d-414f-8e69-cc56229498fe 2023-02-12 06:03:11,404 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb440c95b8245fcb9: from storage DS-c9752502-7b5d-4e92-a822-302cb1ec81d7 node DatanodeRegistration(127.0.0.1:42171, datanodeUuid=d10e44f1-738d-414f-8e69-cc56229498fe, infoPort=34663, infoSecurePort=0, ipcPort=46353, storageInfo=lv=-57;cid=testClusterID;nsid=870845555;c=1676181790810), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 06:03:11,404 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb440c95b8245fcb9: Processing first storage report for DS-3f587442-80f6-47cf-902a-e84a0ba3d792 from datanode d10e44f1-738d-414f-8e69-cc56229498fe 2023-02-12 06:03:11,404 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb440c95b8245fcb9: from storage DS-3f587442-80f6-47cf-902a-e84a0ba3d792 node DatanodeRegistration(127.0.0.1:42171, datanodeUuid=d10e44f1-738d-414f-8e69-cc56229498fe, infoPort=34663, infoSecurePort=0, ipcPort=46353, storageInfo=lv=-57;cid=testClusterID;nsid=870845555;c=1676181790810), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 06:03:11,413 DEBUG [Listener at localhost/46353] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a2a4180-fc2e-d892-681d-2c4f0723a476 2023-02-12 06:03:11,415 INFO [Listener at localhost/46353] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a2a4180-fc2e-d892-681d-2c4f0723a476/cluster_f966ec53-e0ed-65ac-4846-e0b979a5b974/zookeeper_0, clientPort=54909, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a2a4180-fc2e-d892-681d-2c4f0723a476/cluster_f966ec53-e0ed-65ac-4846-e0b979a5b974/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a2a4180-fc2e-d892-681d-2c4f0723a476/cluster_f966ec53-e0ed-65ac-4846-e0b979a5b974/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-12 06:03:11,416 INFO [Listener at localhost/46353] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=54909 2023-02-12 06:03:11,416 INFO [Listener at localhost/46353] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:11,417 INFO [Listener at localhost/46353] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:11,436 INFO [Listener at localhost/46353] util.FSUtils(479): Created version file at hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a with version=8 2023-02-12 06:03:11,437 INFO [Listener at localhost/46353] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:11,437 INFO [Listener at localhost/46353] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:11,439 INFO [Listener at localhost/46353] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/hbase-staging 2023-02-12 06:03:11,440 INFO [Listener at localhost/46353] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 06:03:11,440 INFO [Listener at localhost/46353] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:11,441 INFO [Listener at localhost/46353] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:11,441 INFO [Listener at localhost/46353] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 06:03:11,441 INFO [Listener at localhost/46353] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:11,441 INFO [Listener at localhost/46353] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 06:03:11,441 INFO [Listener at localhost/46353] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 06:03:11,442 INFO [Listener at localhost/46353] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36105 2023-02-12 06:03:11,442 INFO [Listener at localhost/46353] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:11,443 INFO [Listener at localhost/46353] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:11,444 INFO [Listener at localhost/46353] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36105 connecting to ZooKeeper ensemble=127.0.0.1:54909 2023-02-12 06:03:11,456 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:361050x0, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 06:03:11,460 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:36105-0x10047204c7b0000 connected 2023-02-12 06:03:11,487 DEBUG [Listener at localhost/46353] zookeeper.ZKUtil(164): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 06:03:11,487 DEBUG [Listener at localhost/46353] zookeeper.ZKUtil(164): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:03:11,488 DEBUG [Listener at localhost/46353] zookeeper.ZKUtil(164): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 06:03:11,490 DEBUG [Listener at localhost/46353] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36105 2023-02-12 06:03:11,490 DEBUG [Listener at localhost/46353] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36105 2023-02-12 06:03:11,494 DEBUG [Listener at localhost/46353] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36105 2023-02-12 06:03:11,496 DEBUG [Listener at localhost/46353] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36105 2023-02-12 06:03:11,496 DEBUG [Listener at localhost/46353] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36105 2023-02-12 06:03:11,496 INFO [Listener at localhost/46353] master.HMaster(439): hbase.rootdir=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a, hbase.cluster.distributed=false 2023-02-12 06:03:11,509 INFO [Listener at localhost/46353] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 06:03:11,509 INFO [Listener at localhost/46353] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:11,509 INFO [Listener at localhost/46353] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:11,509 INFO [Listener at localhost/46353] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 06:03:11,509 INFO [Listener at localhost/46353] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:11,509 INFO [Listener at localhost/46353] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 06:03:11,509 INFO [Listener at localhost/46353] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 06:03:11,510 INFO [Listener at localhost/46353] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41035 2023-02-12 06:03:11,510 INFO [Listener at localhost/46353] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 06:03:11,516 DEBUG [Listener at localhost/46353] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:03:11,516 INFO [Listener at localhost/46353] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:11,558 INFO [Listener at localhost/46353] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:11,559 INFO [Listener at localhost/46353] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41035 connecting to ZooKeeper ensemble=127.0.0.1:54909 2023-02-12 06:03:11,568 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): regionserver:410350x0, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 06:03:11,569 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41035-0x10047204c7b0001 connected 2023-02-12 06:03:11,569 DEBUG [Listener at localhost/46353] zookeeper.ZKUtil(164): regionserver:41035-0x10047204c7b0001, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 06:03:11,569 DEBUG [Listener at localhost/46353] zookeeper.ZKUtil(164): regionserver:41035-0x10047204c7b0001, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:03:11,570 DEBUG [Listener at localhost/46353] zookeeper.ZKUtil(164): regionserver:41035-0x10047204c7b0001, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 06:03:11,570 DEBUG [Listener at localhost/46353] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41035 2023-02-12 06:03:11,572 DEBUG [Listener at localhost/46353] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41035 2023-02-12 06:03:11,576 DEBUG [Listener at localhost/46353] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41035 2023-02-12 06:03:11,576 DEBUG [Listener at localhost/46353] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41035 2023-02-12 06:03:11,576 DEBUG [Listener at localhost/46353] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41035 2023-02-12 06:03:11,587 INFO [Listener at localhost/46353] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 06:03:11,587 INFO [Listener at localhost/46353] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:11,588 INFO [Listener at localhost/46353] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:11,588 INFO [Listener at localhost/46353] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 06:03:11,588 INFO [Listener at localhost/46353] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:11,588 INFO [Listener at localhost/46353] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 06:03:11,588 INFO [Listener at localhost/46353] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 06:03:11,588 INFO [Listener at localhost/46353] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33593 2023-02-12 06:03:11,589 INFO [Listener at localhost/46353] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 06:03:11,590 DEBUG [Listener at localhost/46353] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:03:11,590 INFO [Listener at localhost/46353] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:11,591 INFO [Listener at localhost/46353] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:11,592 INFO [Listener at localhost/46353] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33593 connecting to ZooKeeper ensemble=127.0.0.1:54909 2023-02-12 06:03:11,595 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): regionserver:335930x0, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 06:03:11,596 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:33593-0x10047204c7b0002 connected 2023-02-12 06:03:11,596 DEBUG [Listener at localhost/46353] zookeeper.ZKUtil(164): regionserver:33593-0x10047204c7b0002, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 06:03:11,597 DEBUG [Listener at localhost/46353] zookeeper.ZKUtil(164): regionserver:33593-0x10047204c7b0002, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:03:11,597 DEBUG [Listener at localhost/46353] zookeeper.ZKUtil(164): regionserver:33593-0x10047204c7b0002, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 06:03:11,600 DEBUG [Listener at localhost/46353] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33593 2023-02-12 06:03:11,600 DEBUG [Listener at localhost/46353] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33593 2023-02-12 06:03:11,600 DEBUG [Listener at localhost/46353] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33593 2023-02-12 06:03:11,601 DEBUG [Listener at localhost/46353] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33593 2023-02-12 06:03:11,604 DEBUG [Listener at localhost/46353] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33593 2023-02-12 06:03:11,605 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,36105,1676181791440 2023-02-12 06:03:11,607 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 06:03:11,607 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,36105,1676181791440 2023-02-12 06:03:11,608 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 06:03:11,608 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): regionserver:41035-0x10047204c7b0001, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 06:03:11,608 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:11,608 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): regionserver:33593-0x10047204c7b0002, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 06:03:11,610 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 06:03:11,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,36105,1676181791440 from backup master directory 2023-02-12 06:03:11,611 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 06:03:11,613 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,36105,1676181791440 2023-02-12 06:03:11,613 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 06:03:11,613 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 06:03:11,613 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,36105,1676181791440 2023-02-12 06:03:11,626 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/hbase.id with ID: 222325c3-225b-4a99-a00a-7824b7f3037a 2023-02-12 06:03:11,635 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:11,638 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:11,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6c574da9 to 127.0.0.1:54909 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 06:03:11,654 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13eebb06, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 06:03:11,655 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 06:03:11,655 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-12 06:03:11,655 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 06:03:11,656 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/MasterData/data/master/store-tmp 2023-02-12 06:03:11,662 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:11,662 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 06:03:11,662 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:11,662 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:11,662 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 06:03:11,662 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:11,662 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:11,662 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676181791662Disabling compacts and flushes for region at 1676181791662Disabling writes for close at 1676181791662Writing region close event to WAL at 1676181791662Closed at 1676181791662 2023-02-12 06:03:11,663 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/MasterData/WALs/jenkins-hbase4.apache.org,36105,1676181791440 2023-02-12 06:03:11,665 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36105%2C1676181791440, suffix=, logDir=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/MasterData/WALs/jenkins-hbase4.apache.org,36105,1676181791440, archiveDir=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/MasterData/oldWALs, maxLogs=10 2023-02-12 06:03:11,681 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42171,DS-c9752502-7b5d-4e92-a822-302cb1ec81d7,DISK] 2023-02-12 06:03:11,681 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45457,DS-613b7c0c-88f6-4bc9-b1d6-b508435f4f84,DISK] 2023-02-12 06:03:11,684 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/MasterData/WALs/jenkins-hbase4.apache.org,36105,1676181791440/jenkins-hbase4.apache.org%2C36105%2C1676181791440.1676181791665 2023-02-12 06:03:11,684 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45457,DS-613b7c0c-88f6-4bc9-b1d6-b508435f4f84,DISK], DatanodeInfoWithStorage[127.0.0.1:42171,DS-c9752502-7b5d-4e92-a822-302cb1ec81d7,DISK]] 2023-02-12 06:03:11,684 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-12 06:03:11,684 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:11,685 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:03:11,685 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:03:11,688 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:03:11,689 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-12 06:03:11,690 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-12 06:03:11,690 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:11,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:03:11,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:03:11,693 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:03:11,695 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:03:11,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68589667, jitterRate=0.02206568419933319}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 06:03:11,695 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676181791685Initializing all the Stores at 1676181791685Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181791685Cleaning up temporary data from old regions at 1676181791692 (+7 ms)Cleaning up detritus from prior splits at 1676181791692Region opened successfully at 1676181791695 (+3 ms) 2023-02-12 06:03:11,696 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-12 06:03:11,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-12 06:03:11,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-12 06:03:11,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-12 06:03:11,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-12 06:03:11,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-12 06:03:11,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-12 06:03:11,700 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-12 06:03:11,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-12 06:03:11,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-12 06:03:11,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-12 06:03:11,712 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-12 06:03:11,712 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-12 06:03:11,712 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-12 06:03:11,714 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:11,715 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-12 06:03:11,715 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-12 06:03:11,716 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-12 06:03:11,718 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): regionserver:41035-0x10047204c7b0001, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 06:03:11,718 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 06:03:11,718 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): regionserver:33593-0x10047204c7b0002, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 06:03:11,718 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:11,719 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,36105,1676181791440, sessionid=0x10047204c7b0000, setting cluster-up flag (Was=false) 2023-02-12 06:03:11,723 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:11,728 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-12 06:03:11,729 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36105,1676181791440 2023-02-12 06:03:11,732 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:11,737 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-12 06:03:11,738 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36105,1676181791440 2023-02-12 06:03:11,738 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.hbase-snapshot/.tmp 2023-02-12 06:03:11,740 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-12 06:03:11,740 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 06:03:11,740 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 06:03:11,740 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 06:03:11,740 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 06:03:11,740 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-12 06:03:11,740 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:11,741 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 06:03:11,741 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:11,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676181821749 2023-02-12 06:03:11,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-12 06:03:11,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-12 06:03:11,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-12 06:03:11,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-12 06:03:11,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-12 06:03:11,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-12 06:03:11,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:11,750 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 06:03:11,750 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-12 06:03:11,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-12 06:03:11,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-12 06:03:11,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-12 06:03:11,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-12 06:03:11,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-12 06:03:11,752 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676181791751,5,FailOnTimeoutGroup] 2023-02-12 06:03:11,752 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676181791752,5,FailOnTimeoutGroup] 2023-02-12 06:03:11,752 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:11,752 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-12 06:03:11,752 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:11,752 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 06:03:11,752 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:11,764 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 06:03:11,764 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 06:03:11,765 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a 2023-02-12 06:03:11,775 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:11,776 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 06:03:11,777 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/hbase/meta/1588230740/info 2023-02-12 06:03:11,777 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 06:03:11,778 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:11,778 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 06:03:11,779 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/hbase/meta/1588230740/rep_barrier 2023-02-12 06:03:11,779 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 06:03:11,780 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:11,780 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 06:03:11,781 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/hbase/meta/1588230740/table 2023-02-12 06:03:11,781 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 06:03:11,781 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:11,782 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/hbase/meta/1588230740 2023-02-12 06:03:11,782 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/hbase/meta/1588230740 2023-02-12 06:03:11,784 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 06:03:11,785 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 06:03:11,786 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:03:11,787 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72887017, jitterRate=0.08610118925571442}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 06:03:11,787 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676181791775Initializing all the Stores at 1676181791775Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676181791775Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181791775Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676181791775Cleaning up temporary data from old regions at 1676181791783 (+8 ms)Cleaning up detritus from prior splits at 1676181791783Region opened successfully at 1676181791787 (+4 ms) 2023-02-12 06:03:11,787 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 06:03:11,787 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 06:03:11,787 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 06:03:11,787 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 06:03:11,787 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 06:03:11,787 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 06:03:11,787 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676181791787Disabling compacts and flushes for region at 1676181791787Disabling writes for close at 1676181791787Writing region close event to WAL at 1676181791787Closed at 1676181791787 2023-02-12 06:03:11,788 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 06:03:11,788 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-12 06:03:11,788 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-12 06:03:11,789 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-12 06:03:11,791 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-12 06:03:11,806 INFO [RS:1;jenkins-hbase4:33593] regionserver.HRegionServer(952): ClusterId : 222325c3-225b-4a99-a00a-7824b7f3037a 2023-02-12 06:03:11,806 INFO [RS:0;jenkins-hbase4:41035] regionserver.HRegionServer(952): ClusterId : 222325c3-225b-4a99-a00a-7824b7f3037a 2023-02-12 06:03:11,806 DEBUG [RS:1;jenkins-hbase4:33593] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 06:03:11,806 DEBUG [RS:0;jenkins-hbase4:41035] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 06:03:11,808 DEBUG [RS:0;jenkins-hbase4:41035] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 06:03:11,808 DEBUG [RS:0;jenkins-hbase4:41035] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 06:03:11,808 DEBUG [RS:1;jenkins-hbase4:33593] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 06:03:11,808 DEBUG [RS:1;jenkins-hbase4:33593] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 06:03:11,812 DEBUG [RS:0;jenkins-hbase4:41035] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 06:03:11,814 DEBUG [RS:1;jenkins-hbase4:33593] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 06:03:11,814 DEBUG [RS:0;jenkins-hbase4:41035] zookeeper.ReadOnlyZKClient(139): Connect 0x40946e26 to 127.0.0.1:54909 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 06:03:11,815 DEBUG [RS:1;jenkins-hbase4:33593] zookeeper.ReadOnlyZKClient(139): Connect 0x4a547229 to 127.0.0.1:54909 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 06:03:11,825 DEBUG [RS:0;jenkins-hbase4:41035] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e538844, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 06:03:11,825 DEBUG [RS:1;jenkins-hbase4:33593] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44938513, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 06:03:11,825 DEBUG [RS:0;jenkins-hbase4:41035] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a6c0556, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 06:03:11,825 DEBUG [RS:1;jenkins-hbase4:33593] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40ac1959, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 06:03:11,837 DEBUG [RS:0;jenkins-hbase4:41035] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:41035 2023-02-12 06:03:11,837 DEBUG [RS:1;jenkins-hbase4:33593] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:33593 2023-02-12 06:03:11,837 INFO [RS:0;jenkins-hbase4:41035] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 06:03:11,837 INFO [RS:0;jenkins-hbase4:41035] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 06:03:11,837 INFO [RS:1;jenkins-hbase4:33593] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 06:03:11,837 INFO [RS:1;jenkins-hbase4:33593] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 06:03:11,837 DEBUG [RS:0;jenkins-hbase4:41035] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 06:03:11,837 DEBUG [RS:1;jenkins-hbase4:33593] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 06:03:11,838 INFO [RS:0;jenkins-hbase4:41035] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,36105,1676181791440 with isa=jenkins-hbase4.apache.org/172.31.14.131:41035, startcode=1676181791508 2023-02-12 06:03:11,838 INFO [RS:1;jenkins-hbase4:33593] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,36105,1676181791440 with isa=jenkins-hbase4.apache.org/172.31.14.131:33593, startcode=1676181791587 2023-02-12 06:03:11,838 DEBUG [RS:0;jenkins-hbase4:41035] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 06:03:11,838 DEBUG [RS:1;jenkins-hbase4:33593] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 06:03:11,840 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46875, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 06:03:11,840 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48371, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 06:03:11,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36105] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:11,841 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:11,842 DEBUG [RS:0;jenkins-hbase4:41035] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a 2023-02-12 06:03:11,842 DEBUG [RS:0;jenkins-hbase4:41035] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:45441 2023-02-12 06:03:11,842 DEBUG [RS:0;jenkins-hbase4:41035] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 06:03:11,842 DEBUG [RS:1;jenkins-hbase4:33593] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a 2023-02-12 06:03:11,842 DEBUG [RS:1;jenkins-hbase4:33593] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:45441 2023-02-12 06:03:11,842 DEBUG [RS:1;jenkins-hbase4:33593] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 06:03:11,845 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 06:03:11,848 DEBUG [RS:0;jenkins-hbase4:41035] zookeeper.ZKUtil(162): regionserver:41035-0x10047204c7b0001, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:11,848 WARN [RS:0;jenkins-hbase4:41035] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 06:03:11,848 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41035,1676181791508] 2023-02-12 06:03:11,848 INFO [RS:0;jenkins-hbase4:41035] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 06:03:11,848 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33593,1676181791587] 2023-02-12 06:03:11,848 DEBUG [RS:1;jenkins-hbase4:33593] zookeeper.ZKUtil(162): regionserver:33593-0x10047204c7b0002, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:11,848 DEBUG [RS:0;jenkins-hbase4:41035] regionserver.HRegionServer(1947): logDir=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/WALs/jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:11,848 WARN [RS:1;jenkins-hbase4:33593] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 06:03:11,848 INFO [RS:1;jenkins-hbase4:33593] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 06:03:11,849 DEBUG [RS:1;jenkins-hbase4:33593] regionserver.HRegionServer(1947): logDir=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/WALs/jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:11,853 DEBUG [RS:1;jenkins-hbase4:33593] zookeeper.ZKUtil(162): regionserver:33593-0x10047204c7b0002, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:11,854 DEBUG [RS:0;jenkins-hbase4:41035] zookeeper.ZKUtil(162): regionserver:41035-0x10047204c7b0001, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:11,854 DEBUG [RS:1;jenkins-hbase4:33593] zookeeper.ZKUtil(162): regionserver:33593-0x10047204c7b0002, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:11,854 DEBUG [RS:0;jenkins-hbase4:41035] zookeeper.ZKUtil(162): regionserver:41035-0x10047204c7b0001, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:11,855 DEBUG [RS:0;jenkins-hbase4:41035] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 06:03:11,855 INFO [RS:0;jenkins-hbase4:41035] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 06:03:11,856 INFO [RS:0;jenkins-hbase4:41035] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 06:03:11,860 INFO [RS:0;jenkins-hbase4:41035] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 06:03:11,860 INFO [RS:0;jenkins-hbase4:41035] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:11,860 INFO [RS:0;jenkins-hbase4:41035] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 06:03:11,861 DEBUG [RS:1;jenkins-hbase4:33593] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 06:03:11,861 INFO [RS:1;jenkins-hbase4:33593] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 06:03:11,861 INFO [RS:0;jenkins-hbase4:41035] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:11,862 DEBUG [RS:0;jenkins-hbase4:41035] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:11,862 DEBUG [RS:0;jenkins-hbase4:41035] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:11,862 DEBUG [RS:0;jenkins-hbase4:41035] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:11,862 DEBUG [RS:0;jenkins-hbase4:41035] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:11,862 DEBUG [RS:0;jenkins-hbase4:41035] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:11,862 DEBUG [RS:0;jenkins-hbase4:41035] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 06:03:11,862 DEBUG [RS:0;jenkins-hbase4:41035] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:11,862 DEBUG [RS:0;jenkins-hbase4:41035] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:11,862 DEBUG [RS:0;jenkins-hbase4:41035] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:11,862 DEBUG [RS:0;jenkins-hbase4:41035] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:11,868 INFO [RS:1;jenkins-hbase4:33593] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 06:03:11,868 INFO [RS:0;jenkins-hbase4:41035] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:11,868 INFO [RS:0;jenkins-hbase4:41035] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:11,869 INFO [RS:0;jenkins-hbase4:41035] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:11,869 INFO [RS:1;jenkins-hbase4:33593] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 06:03:11,869 INFO [RS:1;jenkins-hbase4:33593] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:11,869 INFO [RS:1;jenkins-hbase4:33593] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 06:03:11,870 INFO [RS:1;jenkins-hbase4:33593] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:11,870 DEBUG [RS:1;jenkins-hbase4:33593] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:11,870 DEBUG [RS:1;jenkins-hbase4:33593] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:11,870 DEBUG [RS:1;jenkins-hbase4:33593] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:11,871 DEBUG [RS:1;jenkins-hbase4:33593] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:11,871 DEBUG [RS:1;jenkins-hbase4:33593] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:11,871 DEBUG [RS:1;jenkins-hbase4:33593] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 06:03:11,871 DEBUG [RS:1;jenkins-hbase4:33593] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:11,871 DEBUG [RS:1;jenkins-hbase4:33593] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:11,871 DEBUG [RS:1;jenkins-hbase4:33593] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:11,871 DEBUG [RS:1;jenkins-hbase4:33593] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:11,874 INFO [RS:1;jenkins-hbase4:33593] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:11,874 INFO [RS:1;jenkins-hbase4:33593] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:11,875 INFO [RS:1;jenkins-hbase4:33593] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:11,882 INFO [RS:0;jenkins-hbase4:41035] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 06:03:11,882 INFO [RS:0;jenkins-hbase4:41035] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41035,1676181791508-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:11,890 INFO [RS:1;jenkins-hbase4:33593] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 06:03:11,891 INFO [RS:1;jenkins-hbase4:33593] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33593,1676181791587-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:11,894 INFO [RS:0;jenkins-hbase4:41035] regionserver.Replication(203): jenkins-hbase4.apache.org,41035,1676181791508 started 2023-02-12 06:03:11,894 INFO [RS:0;jenkins-hbase4:41035] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,41035,1676181791508, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41035, sessionid=0x10047204c7b0001 2023-02-12 06:03:11,894 DEBUG [RS:0;jenkins-hbase4:41035] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 06:03:11,894 DEBUG [RS:0;jenkins-hbase4:41035] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:11,894 DEBUG [RS:0;jenkins-hbase4:41035] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41035,1676181791508' 2023-02-12 06:03:11,894 DEBUG [RS:0;jenkins-hbase4:41035] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:03:11,894 DEBUG [RS:0;jenkins-hbase4:41035] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:03:11,894 DEBUG [RS:0;jenkins-hbase4:41035] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 06:03:11,895 DEBUG [RS:0;jenkins-hbase4:41035] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 06:03:11,895 DEBUG [RS:0;jenkins-hbase4:41035] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:11,895 DEBUG [RS:0;jenkins-hbase4:41035] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41035,1676181791508' 2023-02-12 06:03:11,895 DEBUG [RS:0;jenkins-hbase4:41035] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:03:11,895 DEBUG [RS:0;jenkins-hbase4:41035] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:03:11,895 DEBUG [RS:0;jenkins-hbase4:41035] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 06:03:11,895 INFO [RS:0;jenkins-hbase4:41035] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 06:03:11,895 INFO [RS:0;jenkins-hbase4:41035] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 06:03:11,907 INFO [RS:1;jenkins-hbase4:33593] regionserver.Replication(203): jenkins-hbase4.apache.org,33593,1676181791587 started 2023-02-12 06:03:11,907 INFO [RS:1;jenkins-hbase4:33593] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,33593,1676181791587, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33593, sessionid=0x10047204c7b0002 2023-02-12 06:03:11,907 DEBUG [RS:1;jenkins-hbase4:33593] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 06:03:11,907 DEBUG [RS:1;jenkins-hbase4:33593] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:11,907 DEBUG [RS:1;jenkins-hbase4:33593] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33593,1676181791587' 2023-02-12 06:03:11,907 DEBUG [RS:1;jenkins-hbase4:33593] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:03:11,908 DEBUG [RS:1;jenkins-hbase4:33593] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:03:11,908 DEBUG [RS:1;jenkins-hbase4:33593] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 06:03:11,908 DEBUG [RS:1;jenkins-hbase4:33593] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 06:03:11,908 DEBUG [RS:1;jenkins-hbase4:33593] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:11,908 DEBUG [RS:1;jenkins-hbase4:33593] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33593,1676181791587' 2023-02-12 06:03:11,908 DEBUG [RS:1;jenkins-hbase4:33593] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:03:11,909 DEBUG [RS:1;jenkins-hbase4:33593] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:03:11,909 DEBUG [RS:1;jenkins-hbase4:33593] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 06:03:11,909 INFO [RS:1;jenkins-hbase4:33593] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 06:03:11,909 INFO [RS:1;jenkins-hbase4:33593] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 06:03:11,941 DEBUG [jenkins-hbase4:36105] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-12 06:03:11,941 DEBUG [jenkins-hbase4:36105] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 06:03:11,943 DEBUG [jenkins-hbase4:36105] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 06:03:11,943 DEBUG [jenkins-hbase4:36105] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 06:03:11,943 DEBUG [jenkins-hbase4:36105] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 06:03:11,944 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41035,1676181791508, state=OPENING 2023-02-12 06:03:11,946 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-12 06:03:11,948 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:11,948 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 06:03:11,948 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41035,1676181791508}] 2023-02-12 06:03:12,102 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:12,103 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 06:03:12,104 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39362, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 06:03:12,108 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-12 06:03:12,108 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 06:03:12,110 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41035%2C1676181791508.meta, suffix=.meta, logDir=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/WALs/jenkins-hbase4.apache.org,41035,1676181791508, archiveDir=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/oldWALs, maxLogs=32 2023-02-12 06:03:12,126 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45457,DS-613b7c0c-88f6-4bc9-b1d6-b508435f4f84,DISK] 2023-02-12 06:03:12,126 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42171,DS-c9752502-7b5d-4e92-a822-302cb1ec81d7,DISK] 2023-02-12 06:03:12,127 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/WALs/jenkins-hbase4.apache.org,41035,1676181791508/jenkins-hbase4.apache.org%2C41035%2C1676181791508.meta.1676181792110.meta 2023-02-12 06:03:12,128 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42171,DS-c9752502-7b5d-4e92-a822-302cb1ec81d7,DISK], DatanodeInfoWithStorage[127.0.0.1:45457,DS-613b7c0c-88f6-4bc9-b1d6-b508435f4f84,DISK]] 2023-02-12 06:03:12,128 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-12 06:03:12,128 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-12 06:03:12,128 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-12 06:03:12,128 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-12 06:03:12,128 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-12 06:03:12,128 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:12,128 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-12 06:03:12,128 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-12 06:03:12,129 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 06:03:12,130 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/hbase/meta/1588230740/info 2023-02-12 06:03:12,130 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/hbase/meta/1588230740/info 2023-02-12 06:03:12,131 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 06:03:12,131 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:12,131 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 06:03:12,132 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/hbase/meta/1588230740/rep_barrier 2023-02-12 06:03:12,132 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/hbase/meta/1588230740/rep_barrier 2023-02-12 06:03:12,133 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 06:03:12,133 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:12,133 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 06:03:12,134 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/hbase/meta/1588230740/table 2023-02-12 06:03:12,134 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/hbase/meta/1588230740/table 2023-02-12 06:03:12,134 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 06:03:12,135 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:12,135 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/hbase/meta/1588230740 2023-02-12 06:03:12,136 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/hbase/meta/1588230740 2023-02-12 06:03:12,138 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 06:03:12,139 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 06:03:12,139 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65052947, jitterRate=-0.030635550618171692}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 06:03:12,140 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676181792128Writing region info on filesystem at 1676181792128Initializing all the Stores at 1676181792129 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676181792129Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181792129Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676181792129Cleaning up temporary data from old regions at 1676181792137 (+8 ms)Cleaning up detritus from prior splits at 1676181792137Running coprocessor post-open hooks at 1676181792140 (+3 ms)Region opened successfully at 1676181792140 2023-02-12 06:03:12,140 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676181792102 2023-02-12 06:03:12,146 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-12 06:03:12,146 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-12 06:03:12,147 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41035,1676181791508, state=OPEN 2023-02-12 06:03:12,148 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-12 06:03:12,148 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 06:03:12,150 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-12 06:03:12,150 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41035,1676181791508 in 200 msec 2023-02-12 06:03:12,151 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-12 06:03:12,151 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 362 msec 2023-02-12 06:03:12,152 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 413 msec 2023-02-12 06:03:12,152 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676181791607, completionTime=-1 2023-02-12 06:03:12,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-12 06:03:12,153 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-12 06:03:12,155 DEBUG [hconnection-0x34498284-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 06:03:12,156 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39378, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 06:03:12,158 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-12 06:03:12,158 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676181852158 2023-02-12 06:03:12,158 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676181912158 2023-02-12 06:03:12,158 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-12 06:03:12,165 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36105,1676181791440-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:12,165 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36105,1676181791440-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:12,165 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36105,1676181791440-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:12,165 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:36105, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:12,165 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:12,165 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-12 06:03:12,165 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 06:03:12,166 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-12 06:03:12,167 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-12 06:03:12,168 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 06:03:12,169 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 06:03:12,170 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/hbase/namespace/661d0528dccf50bcf6f106de1dd83674 2023-02-12 06:03:12,171 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/hbase/namespace/661d0528dccf50bcf6f106de1dd83674 empty. 2023-02-12 06:03:12,171 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/hbase/namespace/661d0528dccf50bcf6f106de1dd83674 2023-02-12 06:03:12,171 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-12 06:03:12,187 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-12 06:03:12,188 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 661d0528dccf50bcf6f106de1dd83674, NAME => 'hbase:namespace,,1676181792165.661d0528dccf50bcf6f106de1dd83674.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp 2023-02-12 06:03:12,205 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676181792165.661d0528dccf50bcf6f106de1dd83674.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:12,205 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 661d0528dccf50bcf6f106de1dd83674, disabling compactions & flushes 2023-02-12 06:03:12,205 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676181792165.661d0528dccf50bcf6f106de1dd83674. 2023-02-12 06:03:12,205 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676181792165.661d0528dccf50bcf6f106de1dd83674. 2023-02-12 06:03:12,205 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676181792165.661d0528dccf50bcf6f106de1dd83674. after waiting 0 ms 2023-02-12 06:03:12,205 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676181792165.661d0528dccf50bcf6f106de1dd83674. 2023-02-12 06:03:12,205 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676181792165.661d0528dccf50bcf6f106de1dd83674. 2023-02-12 06:03:12,205 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 661d0528dccf50bcf6f106de1dd83674: Waiting for close lock at 1676181792205Disabling compacts and flushes for region at 1676181792205Disabling writes for close at 1676181792205Writing region close event to WAL at 1676181792205Closed at 1676181792205 2023-02-12 06:03:12,207 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 06:03:12,208 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676181792165.661d0528dccf50bcf6f106de1dd83674.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676181792208"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181792208"}]},"ts":"1676181792208"} 2023-02-12 06:03:12,211 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 06:03:12,212 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 06:03:12,212 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676181792212"}]},"ts":"1676181792212"} 2023-02-12 06:03:12,213 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-12 06:03:12,217 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 06:03:12,217 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 06:03:12,217 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 06:03:12,217 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 06:03:12,220 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=661d0528dccf50bcf6f106de1dd83674, ASSIGN}] 2023-02-12 06:03:12,223 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=661d0528dccf50bcf6f106de1dd83674, ASSIGN 2023-02-12 06:03:12,223 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=661d0528dccf50bcf6f106de1dd83674, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33593,1676181791587; forceNewPlan=false, retain=false 2023-02-12 06:03:12,374 INFO [jenkins-hbase4:36105] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 06:03:12,375 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=661d0528dccf50bcf6f106de1dd83674, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:12,375 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676181792165.661d0528dccf50bcf6f106de1dd83674.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676181792375"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181792375"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181792375"}]},"ts":"1676181792375"} 2023-02-12 06:03:12,377 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 661d0528dccf50bcf6f106de1dd83674, server=jenkins-hbase4.apache.org,33593,1676181791587}] 2023-02-12 06:03:12,530 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:12,531 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 06:03:12,532 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33710, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 06:03:12,536 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676181792165.661d0528dccf50bcf6f106de1dd83674. 2023-02-12 06:03:12,538 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33593%2C1676181791587, suffix=, logDir=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/WALs/jenkins-hbase4.apache.org,33593,1676181791587, archiveDir=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/oldWALs, maxLogs=32 2023-02-12 06:03:12,558 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42171,DS-c9752502-7b5d-4e92-a822-302cb1ec81d7,DISK] 2023-02-12 06:03:12,558 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45457,DS-613b7c0c-88f6-4bc9-b1d6-b508435f4f84,DISK] 2023-02-12 06:03:12,560 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/WALs/jenkins-hbase4.apache.org,33593,1676181791587/jenkins-hbase4.apache.org%2C33593%2C1676181791587.1676181792538 2023-02-12 06:03:12,560 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42171,DS-c9752502-7b5d-4e92-a822-302cb1ec81d7,DISK], DatanodeInfoWithStorage[127.0.0.1:45457,DS-613b7c0c-88f6-4bc9-b1d6-b508435f4f84,DISK]] 2023-02-12 06:03:12,560 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 661d0528dccf50bcf6f106de1dd83674, NAME => 'hbase:namespace,,1676181792165.661d0528dccf50bcf6f106de1dd83674.', STARTKEY => '', ENDKEY => ''} 2023-02-12 06:03:12,561 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 661d0528dccf50bcf6f106de1dd83674 2023-02-12 06:03:12,561 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676181792165.661d0528dccf50bcf6f106de1dd83674.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:12,561 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 661d0528dccf50bcf6f106de1dd83674 2023-02-12 06:03:12,561 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 661d0528dccf50bcf6f106de1dd83674 2023-02-12 06:03:12,562 INFO [StoreOpener-661d0528dccf50bcf6f106de1dd83674-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 661d0528dccf50bcf6f106de1dd83674 2023-02-12 06:03:12,564 DEBUG [StoreOpener-661d0528dccf50bcf6f106de1dd83674-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/hbase/namespace/661d0528dccf50bcf6f106de1dd83674/info 2023-02-12 06:03:12,564 DEBUG [StoreOpener-661d0528dccf50bcf6f106de1dd83674-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/hbase/namespace/661d0528dccf50bcf6f106de1dd83674/info 2023-02-12 06:03:12,564 INFO [StoreOpener-661d0528dccf50bcf6f106de1dd83674-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 661d0528dccf50bcf6f106de1dd83674 columnFamilyName info 2023-02-12 06:03:12,565 INFO [StoreOpener-661d0528dccf50bcf6f106de1dd83674-1] regionserver.HStore(310): Store=661d0528dccf50bcf6f106de1dd83674/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:12,566 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/hbase/namespace/661d0528dccf50bcf6f106de1dd83674 2023-02-12 06:03:12,566 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/hbase/namespace/661d0528dccf50bcf6f106de1dd83674 2023-02-12 06:03:12,568 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 661d0528dccf50bcf6f106de1dd83674 2023-02-12 06:03:12,570 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/hbase/namespace/661d0528dccf50bcf6f106de1dd83674/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:03:12,570 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 661d0528dccf50bcf6f106de1dd83674; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74167510, jitterRate=0.10518202185630798}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 06:03:12,570 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 661d0528dccf50bcf6f106de1dd83674: Running coprocessor pre-open hook at 1676181792561Writing region info on filesystem at 1676181792561Initializing all the Stores at 1676181792562 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676181792562Cleaning up temporary data from old regions at 1676181792566 (+4 ms)Cleaning up detritus from prior splits at 1676181792567 (+1 ms)Running coprocessor post-open hooks at 1676181792570 (+3 ms)Region opened successfully at 1676181792570 2023-02-12 06:03:12,571 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676181792165.661d0528dccf50bcf6f106de1dd83674., pid=6, masterSystemTime=1676181792530 2023-02-12 06:03:12,575 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676181792165.661d0528dccf50bcf6f106de1dd83674. 2023-02-12 06:03:12,575 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676181792165.661d0528dccf50bcf6f106de1dd83674. 2023-02-12 06:03:12,576 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=661d0528dccf50bcf6f106de1dd83674, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:12,576 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676181792165.661d0528dccf50bcf6f106de1dd83674.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676181792575"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676181792575"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676181792575"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676181792575"}]},"ts":"1676181792575"} 2023-02-12 06:03:12,579 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-12 06:03:12,579 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 661d0528dccf50bcf6f106de1dd83674, server=jenkins-hbase4.apache.org,33593,1676181791587 in 200 msec 2023-02-12 06:03:12,580 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-12 06:03:12,580 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=661d0528dccf50bcf6f106de1dd83674, ASSIGN in 361 msec 2023-02-12 06:03:12,581 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 06:03:12,581 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676181792581"}]},"ts":"1676181792581"} 2023-02-12 06:03:12,582 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-12 06:03:12,584 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 06:03:12,586 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 420 msec 2023-02-12 06:03:12,667 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-12 06:03:12,668 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-12 06:03:12,668 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:12,671 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 06:03:12,672 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33724, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 06:03:12,675 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-12 06:03:12,684 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 06:03:12,686 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 11 msec 2023-02-12 06:03:12,696 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-12 06:03:12,703 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 06:03:12,705 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-12 06:03:12,711 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-12 06:03:12,713 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-12 06:03:12,713 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.100sec 2023-02-12 06:03:12,714 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-12 06:03:12,714 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-12 06:03:12,714 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-12 06:03:12,714 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36105,1676181791440-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-12 06:03:12,714 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36105,1676181791440-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-12 06:03:12,715 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-12 06:03:12,760 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-12 06:03:12,807 DEBUG [Listener at localhost/46353] zookeeper.ReadOnlyZKClient(139): Connect 0x2d0dd7c5 to 127.0.0.1:54909 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 06:03:12,812 DEBUG [Listener at localhost/46353] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@521568ba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 06:03:12,814 DEBUG [hconnection-0x76c1080e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 06:03:12,817 INFO [RS-EventLoopGroup-13-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39380, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 06:03:12,818 INFO [Listener at localhost/46353] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,36105,1676181791440 2023-02-12 06:03:12,818 DEBUG [Listener at localhost/46353] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-12 06:03:12,822 DEBUG [Listener at localhost/46353] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 06:03:12,824 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58650, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 06:03:12,824 INFO [Listener at localhost/46353] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-12 06:03:12,825 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-12 06:03:12,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-12 06:03:12,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 94 connection: 172.31.14.131:58650 deadline: 1676181852825, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-12 06:03:12,826 INFO [Listener at localhost/46353] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-12 06:03:12,831 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 06:03:12,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:12,834 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 06:03:12,834 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-12 06:03:12,835 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 06:03:12,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 06:03:12,842 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/c9e3aa687caae91031a86b0af14dbc7b 2023-02-12 06:03:12,842 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b 2023-02-12 06:03:12,842 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449 2023-02-12 06:03:12,842 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc 2023-02-12 06:03:12,842 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d 2023-02-12 06:03:12,842 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d 2023-02-12 06:03:12,842 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80 2023-02-12 06:03:12,842 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0 2023-02-12 06:03:12,843 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/c9e3aa687caae91031a86b0af14dbc7b empty. 2023-02-12 06:03:12,843 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80 empty. 2023-02-12 06:03:12,843 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d empty. 2023-02-12 06:03:12,843 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d empty. 2023-02-12 06:03:12,844 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80 2023-02-12 06:03:12,844 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449 empty. 2023-02-12 06:03:12,844 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc empty. 2023-02-12 06:03:12,844 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819 2023-02-12 06:03:12,844 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b empty. 2023-02-12 06:03:12,844 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc 2023-02-12 06:03:12,844 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d 2023-02-12 06:03:12,844 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/530f05fe8dbd50117feed5e471b6c59e 2023-02-12 06:03:12,844 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449 2023-02-12 06:03:12,844 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d 2023-02-12 06:03:12,845 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/c9e3aa687caae91031a86b0af14dbc7b 2023-02-12 06:03:12,845 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/530f05fe8dbd50117feed5e471b6c59e empty. 2023-02-12 06:03:12,845 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0 empty. 2023-02-12 06:03:12,845 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b 2023-02-12 06:03:12,845 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819 empty. 2023-02-12 06:03:12,845 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/530f05fe8dbd50117feed5e471b6c59e 2023-02-12 06:03:12,845 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0 2023-02-12 06:03:12,846 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819 2023-02-12 06:03:12,846 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-12 06:03:12,855 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-12 06:03:12,857 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 85f78445f74da16716afdb76512ecb80, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp 2023-02-12 06:03:12,857 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => c7a9336f8bb0a79325c1dfbd145f634b, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp 2023-02-12 06:03:12,857 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => c9e3aa687caae91031a86b0af14dbc7b, NAME => 'testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp 2023-02-12 06:03:12,868 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:12,868 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 85f78445f74da16716afdb76512ecb80, disabling compactions & flushes 2023-02-12 06:03:12,868 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80. 2023-02-12 06:03:12,868 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80. 2023-02-12 06:03:12,868 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80. after waiting 0 ms 2023-02-12 06:03:12,868 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80. 2023-02-12 06:03:12,868 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80. 2023-02-12 06:03:12,868 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 85f78445f74da16716afdb76512ecb80: Waiting for close lock at 1676181792868Disabling compacts and flushes for region at 1676181792868Disabling writes for close at 1676181792868Writing region close event to WAL at 1676181792868Closed at 1676181792868 2023-02-12 06:03:12,868 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:12,869 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing c7a9336f8bb0a79325c1dfbd145f634b, disabling compactions & flushes 2023-02-12 06:03:12,869 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 76756473478f2c8afca1ab066347a4a0, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp 2023-02-12 06:03:12,869 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b. 2023-02-12 06:03:12,869 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b. 2023-02-12 06:03:12,869 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b. after waiting 0 ms 2023-02-12 06:03:12,869 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b. 2023-02-12 06:03:12,869 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b. 2023-02-12 06:03:12,869 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for c7a9336f8bb0a79325c1dfbd145f634b: Waiting for close lock at 1676181792869Disabling compacts and flushes for region at 1676181792869Disabling writes for close at 1676181792869Writing region close event to WAL at 1676181792869Closed at 1676181792869 2023-02-12 06:03:12,870 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 36c2a20d70c505da7da65238cdb01a2d, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp 2023-02-12 06:03:12,870 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:12,870 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing c9e3aa687caae91031a86b0af14dbc7b, disabling compactions & flushes 2023-02-12 06:03:12,870 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b. 2023-02-12 06:03:12,870 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b. 2023-02-12 06:03:12,870 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b. after waiting 0 ms 2023-02-12 06:03:12,870 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b. 2023-02-12 06:03:12,870 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b. 2023-02-12 06:03:12,870 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for c9e3aa687caae91031a86b0af14dbc7b: Waiting for close lock at 1676181792870Disabling compacts and flushes for region at 1676181792870Disabling writes for close at 1676181792870Writing region close event to WAL at 1676181792870Closed at 1676181792870 2023-02-12 06:03:12,870 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 133d67c01c34b4394253d055b1241449, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676181792831.133d67c01c34b4394253d055b1241449.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp 2023-02-12 06:03:12,883 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676181792831.133d67c01c34b4394253d055b1241449.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:12,883 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 133d67c01c34b4394253d055b1241449, disabling compactions & flushes 2023-02-12 06:03:12,883 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676181792831.133d67c01c34b4394253d055b1241449. 2023-02-12 06:03:12,883 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676181792831.133d67c01c34b4394253d055b1241449. 2023-02-12 06:03:12,883 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676181792831.133d67c01c34b4394253d055b1241449. after waiting 0 ms 2023-02-12 06:03:12,883 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676181792831.133d67c01c34b4394253d055b1241449. 2023-02-12 06:03:12,883 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676181792831.133d67c01c34b4394253d055b1241449. 2023-02-12 06:03:12,883 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 133d67c01c34b4394253d055b1241449: Waiting for close lock at 1676181792883Disabling compacts and flushes for region at 1676181792883Disabling writes for close at 1676181792883Writing region close event to WAL at 1676181792883Closed at 1676181792883 2023-02-12 06:03:12,884 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 77a828f6a35d46d6316183425b87ba6d, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp 2023-02-12 06:03:12,889 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:12,889 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 77a828f6a35d46d6316183425b87ba6d, disabling compactions & flushes 2023-02-12 06:03:12,889 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d. 2023-02-12 06:03:12,889 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d. 2023-02-12 06:03:12,889 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d. after waiting 0 ms 2023-02-12 06:03:12,889 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d. 2023-02-12 06:03:12,889 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d. 2023-02-12 06:03:12,889 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 77a828f6a35d46d6316183425b87ba6d: Waiting for close lock at 1676181792889Disabling compacts and flushes for region at 1676181792889Disabling writes for close at 1676181792889Writing region close event to WAL at 1676181792889Closed at 1676181792889 2023-02-12 06:03:12,890 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 3f09441dd1b0444e613ff01a617719fc, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp 2023-02-12 06:03:12,895 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:12,895 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 3f09441dd1b0444e613ff01a617719fc, disabling compactions & flushes 2023-02-12 06:03:12,895 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc. 2023-02-12 06:03:12,895 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc. 2023-02-12 06:03:12,895 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc. after waiting 0 ms 2023-02-12 06:03:12,895 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc. 2023-02-12 06:03:12,895 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc. 2023-02-12 06:03:12,895 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 3f09441dd1b0444e613ff01a617719fc: Waiting for close lock at 1676181792895Disabling compacts and flushes for region at 1676181792895Disabling writes for close at 1676181792895Writing region close event to WAL at 1676181792895Closed at 1676181792895 2023-02-12 06:03:12,896 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 1427e4a55ff7e244357b88ef84871819, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp 2023-02-12 06:03:12,897 INFO [RS:0;jenkins-hbase4:41035] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41035%2C1676181791508, suffix=, logDir=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/WALs/jenkins-hbase4.apache.org,41035,1676181791508, archiveDir=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/oldWALs, maxLogs=32 2023-02-12 06:03:12,906 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:12,906 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 1427e4a55ff7e244357b88ef84871819, disabling compactions & flushes 2023-02-12 06:03:12,906 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819. 2023-02-12 06:03:12,906 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819. 2023-02-12 06:03:12,906 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819. after waiting 0 ms 2023-02-12 06:03:12,906 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819. 2023-02-12 06:03:12,906 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819. 2023-02-12 06:03:12,906 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 1427e4a55ff7e244357b88ef84871819: Waiting for close lock at 1676181792906Disabling compacts and flushes for region at 1676181792906Disabling writes for close at 1676181792906Writing region close event to WAL at 1676181792906Closed at 1676181792906 2023-02-12 06:03:12,907 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 530f05fe8dbd50117feed5e471b6c59e, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp 2023-02-12 06:03:12,911 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42171,DS-c9752502-7b5d-4e92-a822-302cb1ec81d7,DISK] 2023-02-12 06:03:12,911 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45457,DS-613b7c0c-88f6-4bc9-b1d6-b508435f4f84,DISK] 2023-02-12 06:03:12,916 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:12,916 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 530f05fe8dbd50117feed5e471b6c59e, disabling compactions & flushes 2023-02-12 06:03:12,916 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e. 2023-02-12 06:03:12,916 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e. 2023-02-12 06:03:12,916 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e. after waiting 0 ms 2023-02-12 06:03:12,916 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e. 2023-02-12 06:03:12,916 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e. 2023-02-12 06:03:12,916 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 530f05fe8dbd50117feed5e471b6c59e: Waiting for close lock at 1676181792916Disabling compacts and flushes for region at 1676181792916Disabling writes for close at 1676181792916Writing region close event to WAL at 1676181792916Closed at 1676181792916 2023-02-12 06:03:12,917 INFO [RS:0;jenkins-hbase4:41035] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/WALs/jenkins-hbase4.apache.org,41035,1676181791508/jenkins-hbase4.apache.org%2C41035%2C1676181791508.1676181792897 2023-02-12 06:03:12,917 DEBUG [RS:0;jenkins-hbase4:41035] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42171,DS-c9752502-7b5d-4e92-a822-302cb1ec81d7,DISK], DatanodeInfoWithStorage[127.0.0.1:45457,DS-613b7c0c-88f6-4bc9-b1d6-b508435f4f84,DISK]] 2023-02-12 06:03:12,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 06:03:13,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 06:03:13,278 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:13,278 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 76756473478f2c8afca1ab066347a4a0, disabling compactions & flushes 2023-02-12 06:03:13,278 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0. 2023-02-12 06:03:13,278 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0. 2023-02-12 06:03:13,278 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0. after waiting 0 ms 2023-02-12 06:03:13,278 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0. 2023-02-12 06:03:13,278 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0. 2023-02-12 06:03:13,278 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 76756473478f2c8afca1ab066347a4a0: Waiting for close lock at 1676181793278Disabling compacts and flushes for region at 1676181793278Disabling writes for close at 1676181793278Writing region close event to WAL at 1676181793278Closed at 1676181793278 2023-02-12 06:03:13,282 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:13,282 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 36c2a20d70c505da7da65238cdb01a2d, disabling compactions & flushes 2023-02-12 06:03:13,282 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d. 2023-02-12 06:03:13,282 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d. 2023-02-12 06:03:13,282 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d. after waiting 0 ms 2023-02-12 06:03:13,282 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d. 2023-02-12 06:03:13,282 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d. 2023-02-12 06:03:13,282 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 36c2a20d70c505da7da65238cdb01a2d: Waiting for close lock at 1676181793282Disabling compacts and flushes for region at 1676181793282Disabling writes for close at 1676181793282Writing region close event to WAL at 1676181793282Closed at 1676181793282 2023-02-12 06:03:13,284 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 06:03:13,285 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676181792831.85f78445f74da16716afdb76512ecb80.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676181793285"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181793285"}]},"ts":"1676181793285"} 2023-02-12 06:03:13,285 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676181793285"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181793285"}]},"ts":"1676181793285"} 2023-02-12 06:03:13,285 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676181793285"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181793285"}]},"ts":"1676181793285"} 2023-02-12 06:03:13,285 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676181792831.133d67c01c34b4394253d055b1241449.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676181793285"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181793285"}]},"ts":"1676181793285"} 2023-02-12 06:03:13,285 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676181793285"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181793285"}]},"ts":"1676181793285"} 2023-02-12 06:03:13,285 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676181793285"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181793285"}]},"ts":"1676181793285"} 2023-02-12 06:03:13,285 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676181793285"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181793285"}]},"ts":"1676181793285"} 2023-02-12 06:03:13,286 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676181793285"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181793285"}]},"ts":"1676181793285"} 2023-02-12 06:03:13,286 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676181793285"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181793285"}]},"ts":"1676181793285"} 2023-02-12 06:03:13,286 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676181793285"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181793285"}]},"ts":"1676181793285"} 2023-02-12 06:03:13,288 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-12 06:03:13,289 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 06:03:13,289 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676181793289"}]},"ts":"1676181793289"} 2023-02-12 06:03:13,290 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-12 06:03:13,293 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 06:03:13,299 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 06:03:13,299 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 06:03:13,299 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 06:03:13,299 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c9e3aa687caae91031a86b0af14dbc7b, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c7a9336f8bb0a79325c1dfbd145f634b, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=85f78445f74da16716afdb76512ecb80, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=76756473478f2c8afca1ab066347a4a0, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=36c2a20d70c505da7da65238cdb01a2d, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=133d67c01c34b4394253d055b1241449, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=77a828f6a35d46d6316183425b87ba6d, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3f09441dd1b0444e613ff01a617719fc, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1427e4a55ff7e244357b88ef84871819, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=530f05fe8dbd50117feed5e471b6c59e, ASSIGN}] 2023-02-12 06:03:13,301 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c7a9336f8bb0a79325c1dfbd145f634b, ASSIGN 2023-02-12 06:03:13,301 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=85f78445f74da16716afdb76512ecb80, ASSIGN 2023-02-12 06:03:13,301 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=76756473478f2c8afca1ab066347a4a0, ASSIGN 2023-02-12 06:03:13,302 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c9e3aa687caae91031a86b0af14dbc7b, ASSIGN 2023-02-12 06:03:13,302 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c7a9336f8bb0a79325c1dfbd145f634b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33593,1676181791587; forceNewPlan=false, retain=false 2023-02-12 06:03:13,302 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=85f78445f74da16716afdb76512ecb80, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41035,1676181791508; forceNewPlan=false, retain=false 2023-02-12 06:03:13,302 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=76756473478f2c8afca1ab066347a4a0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41035,1676181791508; forceNewPlan=false, retain=false 2023-02-12 06:03:13,302 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c9e3aa687caae91031a86b0af14dbc7b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41035,1676181791508; forceNewPlan=false, retain=false 2023-02-12 06:03:13,302 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=530f05fe8dbd50117feed5e471b6c59e, ASSIGN 2023-02-12 06:03:13,303 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1427e4a55ff7e244357b88ef84871819, ASSIGN 2023-02-12 06:03:13,303 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=77a828f6a35d46d6316183425b87ba6d, ASSIGN 2023-02-12 06:03:13,303 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3f09441dd1b0444e613ff01a617719fc, ASSIGN 2023-02-12 06:03:13,303 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=133d67c01c34b4394253d055b1241449, ASSIGN 2023-02-12 06:03:13,304 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=530f05fe8dbd50117feed5e471b6c59e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33593,1676181791587; forceNewPlan=false, retain=false 2023-02-12 06:03:13,304 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1427e4a55ff7e244357b88ef84871819, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41035,1676181791508; forceNewPlan=false, retain=false 2023-02-12 06:03:13,304 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=77a828f6a35d46d6316183425b87ba6d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41035,1676181791508; forceNewPlan=false, retain=false 2023-02-12 06:03:13,304 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3f09441dd1b0444e613ff01a617719fc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33593,1676181791587; forceNewPlan=false, retain=false 2023-02-12 06:03:13,304 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=133d67c01c34b4394253d055b1241449, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33593,1676181791587; forceNewPlan=false, retain=false 2023-02-12 06:03:13,305 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=36c2a20d70c505da7da65238cdb01a2d, ASSIGN 2023-02-12 06:03:13,306 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=36c2a20d70c505da7da65238cdb01a2d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33593,1676181791587; forceNewPlan=false, retain=false 2023-02-12 06:03:13,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 06:03:13,453 INFO [jenkins-hbase4:36105] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-12 06:03:13,459 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=76756473478f2c8afca1ab066347a4a0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:13,459 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=77a828f6a35d46d6316183425b87ba6d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:13,459 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676181793459"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181793459"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181793459"}]},"ts":"1676181793459"} 2023-02-12 06:03:13,459 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=85f78445f74da16716afdb76512ecb80, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:13,459 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676181793459"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181793459"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181793459"}]},"ts":"1676181793459"} 2023-02-12 06:03:13,459 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676181792831.85f78445f74da16716afdb76512ecb80.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676181793459"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181793459"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181793459"}]},"ts":"1676181793459"} 2023-02-12 06:03:13,459 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=c9e3aa687caae91031a86b0af14dbc7b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:13,459 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=1427e4a55ff7e244357b88ef84871819, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:13,459 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676181793459"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181793459"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181793459"}]},"ts":"1676181793459"} 2023-02-12 06:03:13,459 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676181793459"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181793459"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181793459"}]},"ts":"1676181793459"} 2023-02-12 06:03:13,460 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=14, state=RUNNABLE; OpenRegionProcedure 76756473478f2c8afca1ab066347a4a0, server=jenkins-hbase4.apache.org,41035,1676181791508}] 2023-02-12 06:03:13,461 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=17, state=RUNNABLE; OpenRegionProcedure 77a828f6a35d46d6316183425b87ba6d, server=jenkins-hbase4.apache.org,41035,1676181791508}] 2023-02-12 06:03:13,462 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=13, state=RUNNABLE; OpenRegionProcedure 85f78445f74da16716afdb76512ecb80, server=jenkins-hbase4.apache.org,41035,1676181791508}] 2023-02-12 06:03:13,462 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=11, state=RUNNABLE; OpenRegionProcedure c9e3aa687caae91031a86b0af14dbc7b, server=jenkins-hbase4.apache.org,41035,1676181791508}] 2023-02-12 06:03:13,463 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=19, state=RUNNABLE; OpenRegionProcedure 1427e4a55ff7e244357b88ef84871819, server=jenkins-hbase4.apache.org,41035,1676181791508}] 2023-02-12 06:03:13,463 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=3f09441dd1b0444e613ff01a617719fc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:13,464 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676181793463"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181793463"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181793463"}]},"ts":"1676181793463"} 2023-02-12 06:03:13,464 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=530f05fe8dbd50117feed5e471b6c59e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:13,465 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676181793464"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181793464"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181793464"}]},"ts":"1676181793464"} 2023-02-12 06:03:13,465 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=c7a9336f8bb0a79325c1dfbd145f634b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:13,465 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676181793465"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181793465"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181793465"}]},"ts":"1676181793465"} 2023-02-12 06:03:13,465 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=18, state=RUNNABLE; OpenRegionProcedure 3f09441dd1b0444e613ff01a617719fc, server=jenkins-hbase4.apache.org,33593,1676181791587}] 2023-02-12 06:03:13,466 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=36c2a20d70c505da7da65238cdb01a2d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:13,466 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676181793466"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181793466"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181793466"}]},"ts":"1676181793466"} 2023-02-12 06:03:13,466 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=133d67c01c34b4394253d055b1241449, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:13,466 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676181792831.133d67c01c34b4394253d055b1241449.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676181793466"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181793466"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181793466"}]},"ts":"1676181793466"} 2023-02-12 06:03:13,466 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=20, state=RUNNABLE; OpenRegionProcedure 530f05fe8dbd50117feed5e471b6c59e, server=jenkins-hbase4.apache.org,33593,1676181791587}] 2023-02-12 06:03:13,467 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=12, state=RUNNABLE; OpenRegionProcedure c7a9336f8bb0a79325c1dfbd145f634b, server=jenkins-hbase4.apache.org,33593,1676181791587}] 2023-02-12 06:03:13,468 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=15, state=RUNNABLE; OpenRegionProcedure 36c2a20d70c505da7da65238cdb01a2d, server=jenkins-hbase4.apache.org,33593,1676181791587}] 2023-02-12 06:03:13,468 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=16, state=RUNNABLE; OpenRegionProcedure 133d67c01c34b4394253d055b1241449, server=jenkins-hbase4.apache.org,33593,1676181791587}] 2023-02-12 06:03:13,616 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0. 2023-02-12 06:03:13,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 76756473478f2c8afca1ab066347a4a0, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-12 06:03:13,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 76756473478f2c8afca1ab066347a4a0 2023-02-12 06:03:13,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:13,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 76756473478f2c8afca1ab066347a4a0 2023-02-12 06:03:13,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 76756473478f2c8afca1ab066347a4a0 2023-02-12 06:03:13,618 INFO [StoreOpener-76756473478f2c8afca1ab066347a4a0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 76756473478f2c8afca1ab066347a4a0 2023-02-12 06:03:13,619 DEBUG [StoreOpener-76756473478f2c8afca1ab066347a4a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/f1 2023-02-12 06:03:13,619 DEBUG [StoreOpener-76756473478f2c8afca1ab066347a4a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/f1 2023-02-12 06:03:13,619 INFO [StoreOpener-76756473478f2c8afca1ab066347a4a0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 76756473478f2c8afca1ab066347a4a0 columnFamilyName f1 2023-02-12 06:03:13,620 INFO [StoreOpener-76756473478f2c8afca1ab066347a4a0-1] regionserver.HStore(310): Store=76756473478f2c8afca1ab066347a4a0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:13,620 INFO [StoreOpener-76756473478f2c8afca1ab066347a4a0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 76756473478f2c8afca1ab066347a4a0 2023-02-12 06:03:13,620 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1676181792831.133d67c01c34b4394253d055b1241449. 2023-02-12 06:03:13,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 133d67c01c34b4394253d055b1241449, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676181792831.133d67c01c34b4394253d055b1241449.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-12 06:03:13,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 133d67c01c34b4394253d055b1241449 2023-02-12 06:03:13,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676181792831.133d67c01c34b4394253d055b1241449.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:13,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 133d67c01c34b4394253d055b1241449 2023-02-12 06:03:13,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 133d67c01c34b4394253d055b1241449 2023-02-12 06:03:13,621 DEBUG [StoreOpener-76756473478f2c8afca1ab066347a4a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/f2 2023-02-12 06:03:13,621 DEBUG [StoreOpener-76756473478f2c8afca1ab066347a4a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/f2 2023-02-12 06:03:13,622 INFO [StoreOpener-133d67c01c34b4394253d055b1241449-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 133d67c01c34b4394253d055b1241449 2023-02-12 06:03:13,622 INFO [StoreOpener-76756473478f2c8afca1ab066347a4a0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 76756473478f2c8afca1ab066347a4a0 columnFamilyName f2 2023-02-12 06:03:13,622 INFO [StoreOpener-76756473478f2c8afca1ab066347a4a0-1] regionserver.HStore(310): Store=76756473478f2c8afca1ab066347a4a0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:13,623 DEBUG [StoreOpener-133d67c01c34b4394253d055b1241449-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/f1 2023-02-12 06:03:13,623 DEBUG [StoreOpener-133d67c01c34b4394253d055b1241449-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/f1 2023-02-12 06:03:13,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0 2023-02-12 06:03:13,623 INFO [StoreOpener-133d67c01c34b4394253d055b1241449-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 133d67c01c34b4394253d055b1241449 columnFamilyName f1 2023-02-12 06:03:13,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0 2023-02-12 06:03:13,623 INFO [StoreOpener-133d67c01c34b4394253d055b1241449-1] regionserver.HStore(310): Store=133d67c01c34b4394253d055b1241449/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:13,624 INFO [StoreOpener-133d67c01c34b4394253d055b1241449-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 133d67c01c34b4394253d055b1241449 2023-02-12 06:03:13,625 DEBUG [StoreOpener-133d67c01c34b4394253d055b1241449-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/f2 2023-02-12 06:03:13,625 DEBUG [StoreOpener-133d67c01c34b4394253d055b1241449-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/f2 2023-02-12 06:03:13,625 INFO [StoreOpener-133d67c01c34b4394253d055b1241449-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 133d67c01c34b4394253d055b1241449 columnFamilyName f2 2023-02-12 06:03:13,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:03:13,625 INFO [StoreOpener-133d67c01c34b4394253d055b1241449-1] regionserver.HStore(310): Store=133d67c01c34b4394253d055b1241449/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:13,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449 2023-02-12 06:03:13,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 76756473478f2c8afca1ab066347a4a0 2023-02-12 06:03:13,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449 2023-02-12 06:03:13,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:03:13,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:03:13,628 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 76756473478f2c8afca1ab066347a4a0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62837793, jitterRate=-0.0636439174413681}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:03:13,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 76756473478f2c8afca1ab066347a4a0: Running coprocessor pre-open hook at 1676181793616Writing region info on filesystem at 1676181793616Initializing all the Stores at 1676181793617 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181793617Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181793617Cleaning up temporary data from old regions at 1676181793624 (+7 ms)Cleaning up detritus from prior splits at 1676181793624Running coprocessor post-open hooks at 1676181793628 (+4 ms)Region opened successfully at 1676181793628 2023-02-12 06:03:13,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 133d67c01c34b4394253d055b1241449 2023-02-12 06:03:13,629 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0., pid=21, masterSystemTime=1676181793612 2023-02-12 06:03:13,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:03:13,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0. 2023-02-12 06:03:13,631 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0. 2023-02-12 06:03:13,631 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 133d67c01c34b4394253d055b1241449; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70017976, jitterRate=0.04334914684295654}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:03:13,631 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80. 2023-02-12 06:03:13,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 133d67c01c34b4394253d055b1241449: Running coprocessor pre-open hook at 1676181793621Writing region info on filesystem at 1676181793621Initializing all the Stores at 1676181793621Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181793621Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181793622 (+1 ms)Cleaning up temporary data from old regions at 1676181793627 (+5 ms)Cleaning up detritus from prior splits at 1676181793627Running coprocessor post-open hooks at 1676181793631 (+4 ms)Region opened successfully at 1676181793631 2023-02-12 06:03:13,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 85f78445f74da16716afdb76512ecb80, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-12 06:03:13,631 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=76756473478f2c8afca1ab066347a4a0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:13,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 85f78445f74da16716afdb76512ecb80 2023-02-12 06:03:13,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:13,632 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676181793631"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676181793631"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676181793631"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676181793631"}]},"ts":"1676181793631"} 2023-02-12 06:03:13,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 85f78445f74da16716afdb76512ecb80 2023-02-12 06:03:13,632 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1676181792831.133d67c01c34b4394253d055b1241449., pid=30, masterSystemTime=1676181793617 2023-02-12 06:03:13,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 85f78445f74da16716afdb76512ecb80 2023-02-12 06:03:13,633 INFO [StoreOpener-85f78445f74da16716afdb76512ecb80-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 85f78445f74da16716afdb76512ecb80 2023-02-12 06:03:13,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1676181792831.133d67c01c34b4394253d055b1241449. 2023-02-12 06:03:13,633 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1676181792831.133d67c01c34b4394253d055b1241449. 2023-02-12 06:03:13,633 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc. 2023-02-12 06:03:13,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3f09441dd1b0444e613ff01a617719fc, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-12 06:03:13,634 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=133d67c01c34b4394253d055b1241449, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:13,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 3f09441dd1b0444e613ff01a617719fc 2023-02-12 06:03:13,634 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676181792831.133d67c01c34b4394253d055b1241449.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676181793634"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676181793634"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676181793634"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676181793634"}]},"ts":"1676181793634"} 2023-02-12 06:03:13,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:13,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3f09441dd1b0444e613ff01a617719fc 2023-02-12 06:03:13,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3f09441dd1b0444e613ff01a617719fc 2023-02-12 06:03:13,635 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=14 2023-02-12 06:03:13,635 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=14, state=SUCCESS; OpenRegionProcedure 76756473478f2c8afca1ab066347a4a0, server=jenkins-hbase4.apache.org,41035,1676181791508 in 173 msec 2023-02-12 06:03:13,635 DEBUG [StoreOpener-85f78445f74da16716afdb76512ecb80-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/f1 2023-02-12 06:03:13,635 DEBUG [StoreOpener-85f78445f74da16716afdb76512ecb80-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/f1 2023-02-12 06:03:13,635 INFO [StoreOpener-85f78445f74da16716afdb76512ecb80-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 85f78445f74da16716afdb76512ecb80 columnFamilyName f1 2023-02-12 06:03:13,636 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=76756473478f2c8afca1ab066347a4a0, ASSIGN in 336 msec 2023-02-12 06:03:13,636 INFO [StoreOpener-85f78445f74da16716afdb76512ecb80-1] regionserver.HStore(310): Store=85f78445f74da16716afdb76512ecb80/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:13,636 INFO [StoreOpener-85f78445f74da16716afdb76512ecb80-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 85f78445f74da16716afdb76512ecb80 2023-02-12 06:03:13,636 INFO [StoreOpener-3f09441dd1b0444e613ff01a617719fc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3f09441dd1b0444e613ff01a617719fc 2023-02-12 06:03:13,637 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=16 2023-02-12 06:03:13,637 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=16, state=SUCCESS; OpenRegionProcedure 133d67c01c34b4394253d055b1241449, server=jenkins-hbase4.apache.org,33593,1676181791587 in 167 msec 2023-02-12 06:03:13,638 DEBUG [StoreOpener-3f09441dd1b0444e613ff01a617719fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/f1 2023-02-12 06:03:13,638 DEBUG [StoreOpener-3f09441dd1b0444e613ff01a617719fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/f1 2023-02-12 06:03:13,638 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=133d67c01c34b4394253d055b1241449, ASSIGN in 338 msec 2023-02-12 06:03:13,638 INFO [StoreOpener-3f09441dd1b0444e613ff01a617719fc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f09441dd1b0444e613ff01a617719fc columnFamilyName f1 2023-02-12 06:03:13,638 INFO [StoreOpener-3f09441dd1b0444e613ff01a617719fc-1] regionserver.HStore(310): Store=3f09441dd1b0444e613ff01a617719fc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:13,638 INFO [StoreOpener-3f09441dd1b0444e613ff01a617719fc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3f09441dd1b0444e613ff01a617719fc 2023-02-12 06:03:13,639 DEBUG [StoreOpener-3f09441dd1b0444e613ff01a617719fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/f2 2023-02-12 06:03:13,639 DEBUG [StoreOpener-3f09441dd1b0444e613ff01a617719fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/f2 2023-02-12 06:03:13,640 INFO [StoreOpener-3f09441dd1b0444e613ff01a617719fc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f09441dd1b0444e613ff01a617719fc columnFamilyName f2 2023-02-12 06:03:13,640 DEBUG [StoreOpener-85f78445f74da16716afdb76512ecb80-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/f2 2023-02-12 06:03:13,640 DEBUG [StoreOpener-85f78445f74da16716afdb76512ecb80-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/f2 2023-02-12 06:03:13,640 INFO [StoreOpener-85f78445f74da16716afdb76512ecb80-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 85f78445f74da16716afdb76512ecb80 columnFamilyName f2 2023-02-12 06:03:13,640 INFO [StoreOpener-3f09441dd1b0444e613ff01a617719fc-1] regionserver.HStore(310): Store=3f09441dd1b0444e613ff01a617719fc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:13,640 INFO [StoreOpener-85f78445f74da16716afdb76512ecb80-1] regionserver.HStore(310): Store=85f78445f74da16716afdb76512ecb80/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:13,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc 2023-02-12 06:03:13,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80 2023-02-12 06:03:13,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc 2023-02-12 06:03:13,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80 2023-02-12 06:03:13,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:03:13,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:03:13,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3f09441dd1b0444e613ff01a617719fc 2023-02-12 06:03:13,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 85f78445f74da16716afdb76512ecb80 2023-02-12 06:03:13,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:03:13,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:03:13,646 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3f09441dd1b0444e613ff01a617719fc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59764103, jitterRate=-0.1094454675912857}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:03:13,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3f09441dd1b0444e613ff01a617719fc: Running coprocessor pre-open hook at 1676181793634Writing region info on filesystem at 1676181793634Initializing all the Stores at 1676181793635 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181793635Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181793636 (+1 ms)Cleaning up temporary data from old regions at 1676181793642 (+6 ms)Cleaning up detritus from prior splits at 1676181793642Running coprocessor post-open hooks at 1676181793646 (+4 ms)Region opened successfully at 1676181793646 2023-02-12 06:03:13,647 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 85f78445f74da16716afdb76512ecb80; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59990602, jitterRate=-0.1060703694820404}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:03:13,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 85f78445f74da16716afdb76512ecb80: Running coprocessor pre-open hook at 1676181793632Writing region info on filesystem at 1676181793632Initializing all the Stores at 1676181793633 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181793633Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181793633Cleaning up temporary data from old regions at 1676181793642 (+9 ms)Cleaning up detritus from prior splits at 1676181793642Running coprocessor post-open hooks at 1676181793647 (+5 ms)Region opened successfully at 1676181793647 2023-02-12 06:03:13,647 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc., pid=26, masterSystemTime=1676181793617 2023-02-12 06:03:13,647 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80., pid=23, masterSystemTime=1676181793612 2023-02-12 06:03:13,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc. 2023-02-12 06:03:13,648 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc. 2023-02-12 06:03:13,648 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d. 2023-02-12 06:03:13,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 36c2a20d70c505da7da65238cdb01a2d, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-12 06:03:13,648 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=3f09441dd1b0444e613ff01a617719fc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:13,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 36c2a20d70c505da7da65238cdb01a2d 2023-02-12 06:03:13,649 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676181793648"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676181793648"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676181793648"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676181793648"}]},"ts":"1676181793648"} 2023-02-12 06:03:13,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:13,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 36c2a20d70c505da7da65238cdb01a2d 2023-02-12 06:03:13,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 36c2a20d70c505da7da65238cdb01a2d 2023-02-12 06:03:13,650 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=85f78445f74da16716afdb76512ecb80, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:13,650 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676181792831.85f78445f74da16716afdb76512ecb80.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676181793650"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676181793650"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676181793650"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676181793650"}]},"ts":"1676181793650"} 2023-02-12 06:03:13,650 INFO [StoreOpener-36c2a20d70c505da7da65238cdb01a2d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 36c2a20d70c505da7da65238cdb01a2d 2023-02-12 06:03:13,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80. 2023-02-12 06:03:13,653 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3f09441dd1b0444e613ff01a617719fc, ASSIGN in 353 msec 2023-02-12 06:03:13,653 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80. 2023-02-12 06:03:13,652 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=13 2023-02-12 06:03:13,654 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819. 2023-02-12 06:03:13,652 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=18 2023-02-12 06:03:13,651 DEBUG [StoreOpener-36c2a20d70c505da7da65238cdb01a2d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/f1 2023-02-12 06:03:13,654 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=18, state=SUCCESS; OpenRegionProcedure 3f09441dd1b0444e613ff01a617719fc, server=jenkins-hbase4.apache.org,33593,1676181791587 in 185 msec 2023-02-12 06:03:13,654 DEBUG [StoreOpener-36c2a20d70c505da7da65238cdb01a2d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/f1 2023-02-12 06:03:13,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1427e4a55ff7e244357b88ef84871819, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-12 06:03:13,654 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=13, state=SUCCESS; OpenRegionProcedure 85f78445f74da16716afdb76512ecb80, server=jenkins-hbase4.apache.org,41035,1676181791508 in 189 msec 2023-02-12 06:03:13,653 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=85f78445f74da16716afdb76512ecb80, ASSIGN in 354 msec 2023-02-12 06:03:13,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 1427e4a55ff7e244357b88ef84871819 2023-02-12 06:03:13,654 INFO [StoreOpener-36c2a20d70c505da7da65238cdb01a2d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 36c2a20d70c505da7da65238cdb01a2d columnFamilyName f1 2023-02-12 06:03:13,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:13,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1427e4a55ff7e244357b88ef84871819 2023-02-12 06:03:13,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1427e4a55ff7e244357b88ef84871819 2023-02-12 06:03:13,654 INFO [StoreOpener-36c2a20d70c505da7da65238cdb01a2d-1] regionserver.HStore(310): Store=36c2a20d70c505da7da65238cdb01a2d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:13,655 INFO [StoreOpener-36c2a20d70c505da7da65238cdb01a2d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 36c2a20d70c505da7da65238cdb01a2d 2023-02-12 06:03:13,655 INFO [StoreOpener-1427e4a55ff7e244357b88ef84871819-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1427e4a55ff7e244357b88ef84871819 2023-02-12 06:03:13,656 DEBUG [StoreOpener-36c2a20d70c505da7da65238cdb01a2d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/f2 2023-02-12 06:03:13,656 DEBUG [StoreOpener-36c2a20d70c505da7da65238cdb01a2d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/f2 2023-02-12 06:03:13,656 INFO [StoreOpener-36c2a20d70c505da7da65238cdb01a2d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 36c2a20d70c505da7da65238cdb01a2d columnFamilyName f2 2023-02-12 06:03:13,656 DEBUG [StoreOpener-1427e4a55ff7e244357b88ef84871819-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/f1 2023-02-12 06:03:13,656 DEBUG [StoreOpener-1427e4a55ff7e244357b88ef84871819-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/f1 2023-02-12 06:03:13,656 INFO [StoreOpener-36c2a20d70c505da7da65238cdb01a2d-1] regionserver.HStore(310): Store=36c2a20d70c505da7da65238cdb01a2d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:13,657 INFO [StoreOpener-1427e4a55ff7e244357b88ef84871819-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1427e4a55ff7e244357b88ef84871819 columnFamilyName f1 2023-02-12 06:03:13,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d 2023-02-12 06:03:13,657 INFO [StoreOpener-1427e4a55ff7e244357b88ef84871819-1] regionserver.HStore(310): Store=1427e4a55ff7e244357b88ef84871819/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:13,657 INFO [StoreOpener-1427e4a55ff7e244357b88ef84871819-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1427e4a55ff7e244357b88ef84871819 2023-02-12 06:03:13,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d 2023-02-12 06:03:13,658 DEBUG [StoreOpener-1427e4a55ff7e244357b88ef84871819-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/f2 2023-02-12 06:03:13,658 DEBUG [StoreOpener-1427e4a55ff7e244357b88ef84871819-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/f2 2023-02-12 06:03:13,659 INFO [StoreOpener-1427e4a55ff7e244357b88ef84871819-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1427e4a55ff7e244357b88ef84871819 columnFamilyName f2 2023-02-12 06:03:13,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:03:13,659 INFO [StoreOpener-1427e4a55ff7e244357b88ef84871819-1] regionserver.HStore(310): Store=1427e4a55ff7e244357b88ef84871819/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:13,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819 2023-02-12 06:03:13,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 36c2a20d70c505da7da65238cdb01a2d 2023-02-12 06:03:13,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:03:13,663 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 36c2a20d70c505da7da65238cdb01a2d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75134095, jitterRate=0.11958526074886322}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:03:13,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 36c2a20d70c505da7da65238cdb01a2d: Running coprocessor pre-open hook at 1676181793649Writing region info on filesystem at 1676181793649Initializing all the Stores at 1676181793650 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181793650Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181793650Cleaning up temporary data from old regions at 1676181793658 (+8 ms)Cleaning up detritus from prior splits at 1676181793658Running coprocessor post-open hooks at 1676181793663 (+5 ms)Region opened successfully at 1676181793663 2023-02-12 06:03:13,663 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d., pid=29, masterSystemTime=1676181793617 2023-02-12 06:03:13,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d. 2023-02-12 06:03:13,665 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d. 2023-02-12 06:03:13,665 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b. 2023-02-12 06:03:13,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c7a9336f8bb0a79325c1dfbd145f634b, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-12 06:03:13,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion c7a9336f8bb0a79325c1dfbd145f634b 2023-02-12 06:03:13,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:13,665 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=36c2a20d70c505da7da65238cdb01a2d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:13,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c7a9336f8bb0a79325c1dfbd145f634b 2023-02-12 06:03:13,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c7a9336f8bb0a79325c1dfbd145f634b 2023-02-12 06:03:13,665 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676181793665"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676181793665"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676181793665"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676181793665"}]},"ts":"1676181793665"} 2023-02-12 06:03:13,668 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=15 2023-02-12 06:03:13,668 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=15, state=SUCCESS; OpenRegionProcedure 36c2a20d70c505da7da65238cdb01a2d, server=jenkins-hbase4.apache.org,33593,1676181791587 in 199 msec 2023-02-12 06:03:13,669 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=36c2a20d70c505da7da65238cdb01a2d, ASSIGN in 369 msec 2023-02-12 06:03:13,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819 2023-02-12 06:03:13,672 INFO [StoreOpener-c7a9336f8bb0a79325c1dfbd145f634b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c7a9336f8bb0a79325c1dfbd145f634b 2023-02-12 06:03:13,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:03:13,673 DEBUG [StoreOpener-c7a9336f8bb0a79325c1dfbd145f634b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/f1 2023-02-12 06:03:13,673 DEBUG [StoreOpener-c7a9336f8bb0a79325c1dfbd145f634b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/f1 2023-02-12 06:03:13,674 INFO [StoreOpener-c7a9336f8bb0a79325c1dfbd145f634b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7a9336f8bb0a79325c1dfbd145f634b columnFamilyName f1 2023-02-12 06:03:13,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1427e4a55ff7e244357b88ef84871819 2023-02-12 06:03:13,674 INFO [StoreOpener-c7a9336f8bb0a79325c1dfbd145f634b-1] regionserver.HStore(310): Store=c7a9336f8bb0a79325c1dfbd145f634b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:13,674 INFO [StoreOpener-c7a9336f8bb0a79325c1dfbd145f634b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c7a9336f8bb0a79325c1dfbd145f634b 2023-02-12 06:03:13,676 DEBUG [StoreOpener-c7a9336f8bb0a79325c1dfbd145f634b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/f2 2023-02-12 06:03:13,676 DEBUG [StoreOpener-c7a9336f8bb0a79325c1dfbd145f634b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/f2 2023-02-12 06:03:13,676 INFO [StoreOpener-c7a9336f8bb0a79325c1dfbd145f634b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7a9336f8bb0a79325c1dfbd145f634b columnFamilyName f2 2023-02-12 06:03:13,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:03:13,676 INFO [StoreOpener-c7a9336f8bb0a79325c1dfbd145f634b-1] regionserver.HStore(310): Store=c7a9336f8bb0a79325c1dfbd145f634b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:13,676 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1427e4a55ff7e244357b88ef84871819; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72534677, jitterRate=0.08085091412067413}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:03:13,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1427e4a55ff7e244357b88ef84871819: Running coprocessor pre-open hook at 1676181793654Writing region info on filesystem at 1676181793654Initializing all the Stores at 1676181793655 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181793655Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181793655Cleaning up temporary data from old regions at 1676181793672 (+17 ms)Cleaning up detritus from prior splits at 1676181793672Running coprocessor post-open hooks at 1676181793677 (+5 ms)Region opened successfully at 1676181793677 2023-02-12 06:03:13,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b 2023-02-12 06:03:13,677 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819., pid=25, masterSystemTime=1676181793612 2023-02-12 06:03:13,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b 2023-02-12 06:03:13,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819. 2023-02-12 06:03:13,679 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819. 2023-02-12 06:03:13,679 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d. 2023-02-12 06:03:13,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 77a828f6a35d46d6316183425b87ba6d, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-12 06:03:13,679 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=1427e4a55ff7e244357b88ef84871819, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:13,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 77a828f6a35d46d6316183425b87ba6d 2023-02-12 06:03:13,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:03:13,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:13,679 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676181793679"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676181793679"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676181793679"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676181793679"}]},"ts":"1676181793679"} 2023-02-12 06:03:13,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 77a828f6a35d46d6316183425b87ba6d 2023-02-12 06:03:13,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 77a828f6a35d46d6316183425b87ba6d 2023-02-12 06:03:13,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c7a9336f8bb0a79325c1dfbd145f634b 2023-02-12 06:03:13,681 INFO [StoreOpener-77a828f6a35d46d6316183425b87ba6d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 77a828f6a35d46d6316183425b87ba6d 2023-02-12 06:03:13,688 DEBUG [StoreOpener-77a828f6a35d46d6316183425b87ba6d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/f1 2023-02-12 06:03:13,688 DEBUG [StoreOpener-77a828f6a35d46d6316183425b87ba6d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/f1 2023-02-12 06:03:13,689 INFO [StoreOpener-77a828f6a35d46d6316183425b87ba6d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 77a828f6a35d46d6316183425b87ba6d columnFamilyName f1 2023-02-12 06:03:13,689 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=19 2023-02-12 06:03:13,689 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=19, state=SUCCESS; OpenRegionProcedure 1427e4a55ff7e244357b88ef84871819, server=jenkins-hbase4.apache.org,41035,1676181791508 in 218 msec 2023-02-12 06:03:13,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:03:13,689 INFO [StoreOpener-77a828f6a35d46d6316183425b87ba6d-1] regionserver.HStore(310): Store=77a828f6a35d46d6316183425b87ba6d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:13,689 INFO [StoreOpener-77a828f6a35d46d6316183425b87ba6d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 77a828f6a35d46d6316183425b87ba6d 2023-02-12 06:03:13,690 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c7a9336f8bb0a79325c1dfbd145f634b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72112382, jitterRate=0.07455822825431824}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:03:13,690 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1427e4a55ff7e244357b88ef84871819, ASSIGN in 390 msec 2023-02-12 06:03:13,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c7a9336f8bb0a79325c1dfbd145f634b: Running coprocessor pre-open hook at 1676181793665Writing region info on filesystem at 1676181793665Initializing all the Stores at 1676181793666 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181793666Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181793672 (+6 ms)Cleaning up temporary data from old regions at 1676181793678 (+6 ms)Cleaning up detritus from prior splits at 1676181793679 (+1 ms)Running coprocessor post-open hooks at 1676181793690 (+11 ms)Region opened successfully at 1676181793690 2023-02-12 06:03:13,691 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b., pid=28, masterSystemTime=1676181793617 2023-02-12 06:03:13,691 DEBUG [StoreOpener-77a828f6a35d46d6316183425b87ba6d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/f2 2023-02-12 06:03:13,691 DEBUG [StoreOpener-77a828f6a35d46d6316183425b87ba6d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/f2 2023-02-12 06:03:13,691 INFO [StoreOpener-77a828f6a35d46d6316183425b87ba6d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 77a828f6a35d46d6316183425b87ba6d columnFamilyName f2 2023-02-12 06:03:13,692 INFO [StoreOpener-77a828f6a35d46d6316183425b87ba6d-1] regionserver.HStore(310): Store=77a828f6a35d46d6316183425b87ba6d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:13,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b. 2023-02-12 06:03:13,692 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b. 2023-02-12 06:03:13,693 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e. 2023-02-12 06:03:13,693 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=c7a9336f8bb0a79325c1dfbd145f634b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:13,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 530f05fe8dbd50117feed5e471b6c59e, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-12 06:03:13,693 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676181793693"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676181793693"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676181793693"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676181793693"}]},"ts":"1676181793693"} 2023-02-12 06:03:13,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 530f05fe8dbd50117feed5e471b6c59e 2023-02-12 06:03:13,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:13,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d 2023-02-12 06:03:13,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 530f05fe8dbd50117feed5e471b6c59e 2023-02-12 06:03:13,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 530f05fe8dbd50117feed5e471b6c59e 2023-02-12 06:03:13,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d 2023-02-12 06:03:13,695 INFO [StoreOpener-530f05fe8dbd50117feed5e471b6c59e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 530f05fe8dbd50117feed5e471b6c59e 2023-02-12 06:03:13,696 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=12 2023-02-12 06:03:13,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:03:13,696 DEBUG [StoreOpener-530f05fe8dbd50117feed5e471b6c59e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/530f05fe8dbd50117feed5e471b6c59e/f1 2023-02-12 06:03:13,696 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=12, state=SUCCESS; OpenRegionProcedure c7a9336f8bb0a79325c1dfbd145f634b, server=jenkins-hbase4.apache.org,33593,1676181791587 in 227 msec 2023-02-12 06:03:13,696 DEBUG [StoreOpener-530f05fe8dbd50117feed5e471b6c59e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/530f05fe8dbd50117feed5e471b6c59e/f1 2023-02-12 06:03:13,697 INFO [StoreOpener-530f05fe8dbd50117feed5e471b6c59e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 530f05fe8dbd50117feed5e471b6c59e columnFamilyName f1 2023-02-12 06:03:13,697 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c7a9336f8bb0a79325c1dfbd145f634b, ASSIGN in 397 msec 2023-02-12 06:03:13,697 INFO [StoreOpener-530f05fe8dbd50117feed5e471b6c59e-1] regionserver.HStore(310): Store=530f05fe8dbd50117feed5e471b6c59e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:13,698 INFO [StoreOpener-530f05fe8dbd50117feed5e471b6c59e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 530f05fe8dbd50117feed5e471b6c59e 2023-02-12 06:03:13,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 77a828f6a35d46d6316183425b87ba6d 2023-02-12 06:03:13,699 DEBUG [StoreOpener-530f05fe8dbd50117feed5e471b6c59e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/530f05fe8dbd50117feed5e471b6c59e/f2 2023-02-12 06:03:13,699 DEBUG [StoreOpener-530f05fe8dbd50117feed5e471b6c59e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/530f05fe8dbd50117feed5e471b6c59e/f2 2023-02-12 06:03:13,699 INFO [StoreOpener-530f05fe8dbd50117feed5e471b6c59e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 530f05fe8dbd50117feed5e471b6c59e columnFamilyName f2 2023-02-12 06:03:13,700 INFO [StoreOpener-530f05fe8dbd50117feed5e471b6c59e-1] regionserver.HStore(310): Store=530f05fe8dbd50117feed5e471b6c59e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:13,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:03:13,701 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 77a828f6a35d46d6316183425b87ba6d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69067405, jitterRate=0.029184535145759583}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:03:13,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/530f05fe8dbd50117feed5e471b6c59e 2023-02-12 06:03:13,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 77a828f6a35d46d6316183425b87ba6d: Running coprocessor pre-open hook at 1676181793680Writing region info on filesystem at 1676181793680Initializing all the Stores at 1676181793681 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181793681Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181793681Cleaning up temporary data from old regions at 1676181793695 (+14 ms)Cleaning up detritus from prior splits at 1676181793695Running coprocessor post-open hooks at 1676181793701 (+6 ms)Region opened successfully at 1676181793701 2023-02-12 06:03:13,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/530f05fe8dbd50117feed5e471b6c59e 2023-02-12 06:03:13,702 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d., pid=22, masterSystemTime=1676181793612 2023-02-12 06:03:13,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:03:13,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d. 2023-02-12 06:03:13,703 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d. 2023-02-12 06:03:13,704 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b. 2023-02-12 06:03:13,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c9e3aa687caae91031a86b0af14dbc7b, NAME => 'testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-12 06:03:13,704 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=77a828f6a35d46d6316183425b87ba6d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:13,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion c9e3aa687caae91031a86b0af14dbc7b 2023-02-12 06:03:13,704 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676181793704"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676181793704"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676181793704"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676181793704"}]},"ts":"1676181793704"} 2023-02-12 06:03:13,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:13,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c9e3aa687caae91031a86b0af14dbc7b 2023-02-12 06:03:13,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c9e3aa687caae91031a86b0af14dbc7b 2023-02-12 06:03:13,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 530f05fe8dbd50117feed5e471b6c59e 2023-02-12 06:03:13,706 INFO [StoreOpener-c9e3aa687caae91031a86b0af14dbc7b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c9e3aa687caae91031a86b0af14dbc7b 2023-02-12 06:03:13,707 DEBUG [StoreOpener-c9e3aa687caae91031a86b0af14dbc7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/c9e3aa687caae91031a86b0af14dbc7b/f1 2023-02-12 06:03:13,707 DEBUG [StoreOpener-c9e3aa687caae91031a86b0af14dbc7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/c9e3aa687caae91031a86b0af14dbc7b/f1 2023-02-12 06:03:13,708 INFO [StoreOpener-c9e3aa687caae91031a86b0af14dbc7b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c9e3aa687caae91031a86b0af14dbc7b columnFamilyName f1 2023-02-12 06:03:13,708 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=17 2023-02-12 06:03:13,708 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=17, state=SUCCESS; OpenRegionProcedure 77a828f6a35d46d6316183425b87ba6d, server=jenkins-hbase4.apache.org,41035,1676181791508 in 245 msec 2023-02-12 06:03:13,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/530f05fe8dbd50117feed5e471b6c59e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:03:13,708 INFO [StoreOpener-c9e3aa687caae91031a86b0af14dbc7b-1] regionserver.HStore(310): Store=c9e3aa687caae91031a86b0af14dbc7b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:13,708 INFO [StoreOpener-c9e3aa687caae91031a86b0af14dbc7b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c9e3aa687caae91031a86b0af14dbc7b 2023-02-12 06:03:13,709 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 530f05fe8dbd50117feed5e471b6c59e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72570661, jitterRate=0.08138711750507355}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:03:13,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 530f05fe8dbd50117feed5e471b6c59e: Running coprocessor pre-open hook at 1676181793693Writing region info on filesystem at 1676181793693Initializing all the Stores at 1676181793694 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181793694Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181793695 (+1 ms)Cleaning up temporary data from old regions at 1676181793702 (+7 ms)Cleaning up detritus from prior splits at 1676181793702Running coprocessor post-open hooks at 1676181793709 (+7 ms)Region opened successfully at 1676181793709 2023-02-12 06:03:13,709 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=77a828f6a35d46d6316183425b87ba6d, ASSIGN in 409 msec 2023-02-12 06:03:13,709 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e., pid=27, masterSystemTime=1676181793617 2023-02-12 06:03:13,710 DEBUG [StoreOpener-c9e3aa687caae91031a86b0af14dbc7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/c9e3aa687caae91031a86b0af14dbc7b/f2 2023-02-12 06:03:13,710 DEBUG [StoreOpener-c9e3aa687caae91031a86b0af14dbc7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/c9e3aa687caae91031a86b0af14dbc7b/f2 2023-02-12 06:03:13,710 INFO [StoreOpener-c9e3aa687caae91031a86b0af14dbc7b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c9e3aa687caae91031a86b0af14dbc7b columnFamilyName f2 2023-02-12 06:03:13,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e. 2023-02-12 06:03:13,711 INFO [StoreOpener-c9e3aa687caae91031a86b0af14dbc7b-1] regionserver.HStore(310): Store=c9e3aa687caae91031a86b0af14dbc7b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:13,711 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e. 2023-02-12 06:03:13,711 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=530f05fe8dbd50117feed5e471b6c59e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:13,711 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676181793711"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676181793711"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676181793711"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676181793711"}]},"ts":"1676181793711"} 2023-02-12 06:03:13,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/c9e3aa687caae91031a86b0af14dbc7b 2023-02-12 06:03:13,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/c9e3aa687caae91031a86b0af14dbc7b 2023-02-12 06:03:13,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:03:13,714 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=20 2023-02-12 06:03:13,714 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=20, state=SUCCESS; OpenRegionProcedure 530f05fe8dbd50117feed5e471b6c59e, server=jenkins-hbase4.apache.org,33593,1676181791587 in 247 msec 2023-02-12 06:03:13,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c9e3aa687caae91031a86b0af14dbc7b 2023-02-12 06:03:13,715 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=530f05fe8dbd50117feed5e471b6c59e, ASSIGN in 415 msec 2023-02-12 06:03:13,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/c9e3aa687caae91031a86b0af14dbc7b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:03:13,717 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c9e3aa687caae91031a86b0af14dbc7b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75405497, jitterRate=0.12362946569919586}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:03:13,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c9e3aa687caae91031a86b0af14dbc7b: Running coprocessor pre-open hook at 1676181793704Writing region info on filesystem at 1676181793704Initializing all the Stores at 1676181793705 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181793705Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181793706 (+1 ms)Cleaning up temporary data from old regions at 1676181793713 (+7 ms)Cleaning up detritus from prior splits at 1676181793713Running coprocessor post-open hooks at 1676181793717 (+4 ms)Region opened successfully at 1676181793717 2023-02-12 06:03:13,718 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b., pid=24, masterSystemTime=1676181793612 2023-02-12 06:03:13,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b. 2023-02-12 06:03:13,719 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b. 2023-02-12 06:03:13,719 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=c9e3aa687caae91031a86b0af14dbc7b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:13,719 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676181793719"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676181793719"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676181793719"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676181793719"}]},"ts":"1676181793719"} 2023-02-12 06:03:13,722 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=11 2023-02-12 06:03:13,722 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=11, state=SUCCESS; OpenRegionProcedure c9e3aa687caae91031a86b0af14dbc7b, server=jenkins-hbase4.apache.org,41035,1676181791508 in 258 msec 2023-02-12 06:03:13,723 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-12 06:03:13,723 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c9e3aa687caae91031a86b0af14dbc7b, ASSIGN in 423 msec 2023-02-12 06:03:13,724 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 06:03:13,724 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676181793724"}]},"ts":"1676181793724"} 2023-02-12 06:03:13,725 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-12 06:03:13,727 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 06:03:13,728 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 896 msec 2023-02-12 06:03:13,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 06:03:13,941 INFO [Listener at localhost/46353] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-12 06:03:13,942 DEBUG [Listener at localhost/46353] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-12 06:03:13,942 INFO [Listener at localhost/46353] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 06:03:13,945 INFO [Listener at localhost/46353] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-12 06:03:13,945 INFO [Listener at localhost/46353] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 06:03:13,945 INFO [Listener at localhost/46353] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-12 06:03:13,945 INFO [Listener at localhost/46353] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-12 06:03:14,001 DEBUG [hconnection-0x76c1080e-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 06:03:14,012 INFO [RS-EventLoopGroup-14-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53802, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 06:03:14,016 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41035] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80. 2023-02-12 06:03:14,018 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33593] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b. 2023-02-12 06:03:14,104 INFO [Listener at localhost/46353] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-12 06:03:14,104 INFO [Listener at localhost/46353] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-12 06:03:14,106 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-12 06:03:14,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676181794106 (current time:1676181794106). 2023-02-12 06:03:14,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-12 06:03:14,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] zookeeper.ReadOnlyZKClient(139): Connect 0x49f53780 to 127.0.0.1:54909 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 06:03:14,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f916ae2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 06:03:14,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 06:03:14,116 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56986, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 06:03:14,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x49f53780 to 127.0.0.1:54909 2023-02-12 06:03:14,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:14,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-12 06:03:14,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-12 06:03:14,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-12 06:03:14,122 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-12 06:03:14,122 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676182394122 2023-02-12 06:03:14,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-12 06:03:14,127 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,129 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-12 06:03:14,129 DEBUG [Listener at localhost/46353] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-12 06:03:14,129 DEBUG [Listener at localhost/46353] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-12 06:03:14,130 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-12 06:03:14,130 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 9 msec 2023-02-12 06:03:14,131 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-12 06:03:14,131 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1676182394131 2023-02-12 06:03:14,142 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,143 INFO [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-12 06:03:14,143 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 06:03:14,143 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-12 06:03:14,143 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-12 06:03:14,144 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,144 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,145 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): regionserver:33593-0x10047204c7b0002, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 06:03:14,145 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): regionserver:41035-0x10047204c7b0001, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 06:03:14,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 06:03:14,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 06:03:14,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:03:14,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:03:14,145 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:14,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,146 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:14,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,146 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:14,146 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33593-0x10047204c7b0002, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,146 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41035-0x10047204c7b0001, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,146 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:14,146 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 06:03:14,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-12 06:03:14,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,146 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-12 06:03:14,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-12 06:03:14,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,146 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-12 06:03:14,146 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,147 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,147 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-12 06:03:14,147 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 06:03:14,149 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-12 06:03:14,149 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-12 06:03:14,149 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 06:03:14,149 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-12 06:03:14,149 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33593,1676181791587' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-12 06:03:14,149 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-12 06:03:14,149 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-12 06:03:14,149 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41035,1676181791508' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-12 06:03:14,150 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:14,150 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:14,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:14,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 06:03:14,152 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:14,152 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33593-0x10047204c7b0002, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,152 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 06:03:14,152 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:14,153 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41035-0x10047204c7b0001, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,153 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 06:03:14,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:14,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:14,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:14,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:14,154 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33593,1676181791587' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-12 06:03:14,154 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27d41fc2[Count = 1] remaining members to acquire global barrier 2023-02-12 06:03:14,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:14,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:14,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 06:03:14,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:14,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:14,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:14,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:14,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:14,156 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41035,1676181791508' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-12 06:03:14,156 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27d41fc2[Count = 0] remaining members to acquire global barrier 2023-02-12 06:03:14,156 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-12 06:03:14,156 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,157 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): regionserver:33593-0x10047204c7b0002, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,157 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): regionserver:41035-0x10047204c7b0001, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,157 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-12 06:03:14,157 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:14,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,157 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-12 06:03:14,157 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d. 2023-02-12 06:03:14,157 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d. started... 2023-02-12 06:03:14,157 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b. 2023-02-12 06:03:14,157 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:14,157 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e. 2023-02-12 06:03:14,157 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-12 06:03:14,158 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d. 2023-02-12 06:03:14,158 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 06:03:14,158 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 36c2a20d70c505da7da65238cdb01a2d 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 06:03:14,158 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e. started... 2023-02-12 06:03:14,158 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 06:03:14,157 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b. started... 2023-02-12 06:03:14,158 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d. started... 2023-02-12 06:03:14,160 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 530f05fe8dbd50117feed5e471b6c59e: 2023-02-12 06:03:14,160 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 77a828f6a35d46d6316183425b87ba6d 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 06:03:14,160 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-12 06:03:14,161 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b. 2023-02-12 06:03:14,160 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80. 2023-02-12 06:03:14,160 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-1] regionserver.HRegion(2744): Flushing c7a9336f8bb0a79325c1dfbd145f634b 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-12 06:03:14,161 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80. started... 2023-02-12 06:03:14,161 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b. started... 2023-02-12 06:03:14,161 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,162 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for c9e3aa687caae91031a86b0af14dbc7b: 2023-02-12 06:03:14,161 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 06:03:14,161 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 85f78445f74da16716afdb76512ecb80 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 06:03:14,163 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,163 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 06:03:14,164 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 06:03:14,164 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 06:03:14,164 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 06:03:14,164 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 06:03:14,164 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-12 06:03:14,188 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b. completed. 2023-02-12 06:03:14,188 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b. 2023-02-12 06:03:14,188 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0. 2023-02-12 06:03:14,188 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-12 06:03:14,188 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0. started... 2023-02-12 06:03:14,192 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e. completed. 2023-02-12 06:03:14,192 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e. 2023-02-12 06:03:14,192 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676181792831.133d67c01c34b4394253d055b1241449. 2023-02-12 06:03:14,192 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-12 06:03:14,192 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676181792831.133d67c01c34b4394253d055b1241449. started... 2023-02-12 06:03:14,197 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 76756473478f2c8afca1ab066347a4a0 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 06:03:14,197 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 133d67c01c34b4394253d055b1241449 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 06:03:14,204 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/.tmp/f1/b66b61dc87ab475bb9dd8b442d40b08b 2023-02-12 06:03:14,205 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/.tmp/f1/df193a96811949fea9c667f090d8daed 2023-02-12 06:03:14,212 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/.tmp/f1/5ecd0027248444cda169180d9f1fa4fa 2023-02-12 06:03:14,216 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/.tmp/f1/6a40b939d810444db0b9ae1c7bda56e7 2023-02-12 06:03:14,230 DEBUG [Listener at localhost/46353] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 06:03:14,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-12 06:03:14,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-12 06:03:14,232 DEBUG [Listener at localhost/46353] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-12 06:03:14,242 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/.tmp/f1/c6eaf0a2e96540d09d8a3b25e52ac0a5 2023-02-12 06:03:14,252 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/.tmp/f2/85d74dd407604825ab015d4371bbda74 2023-02-12 06:03:14,254 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/.tmp/f1/7e0d41db2f15422f99136a86786ad9c7 2023-02-12 06:03:14,260 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/.tmp/f2/8755b9d62b29447a88c673100ec1fe73 2023-02-12 06:03:14,264 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/.tmp/f1/df193a96811949fea9c667f090d8daed as hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/f1/df193a96811949fea9c667f090d8daed 2023-02-12 06:03:14,269 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/f1/df193a96811949fea9c667f090d8daed, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 06:03:14,270 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/.tmp/f2/8755b9d62b29447a88c673100ec1fe73 as hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/f2/8755b9d62b29447a88c673100ec1fe73 2023-02-12 06:03:14,274 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/f2/8755b9d62b29447a88c673100ec1fe73, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 06:03:14,275 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 36c2a20d70c505da7da65238cdb01a2d in 117ms, sequenceid=5, compaction requested=false 2023-02-12 06:03:14,275 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-12 06:03:14,276 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 36c2a20d70c505da7da65238cdb01a2d: 2023-02-12 06:03:14,276 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,276 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 06:03:14,276 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/f1/df193a96811949fea9c667f090d8daed] hfiles 2023-02-12 06:03:14,276 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/f1/df193a96811949fea9c667f090d8daed for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,277 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/f2/8755b9d62b29447a88c673100ec1fe73] hfiles 2023-02-12 06:03:14,277 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/f2/8755b9d62b29447a88c673100ec1fe73 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,288 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/.tmp/f2/6c20a7b29b8443c78c81ef9262cf1e09 2023-02-12 06:03:14,294 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/.tmp/f1/5ecd0027248444cda169180d9f1fa4fa as hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/f1/5ecd0027248444cda169180d9f1fa4fa 2023-02-12 06:03:14,294 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/.tmp/f1/b66b61dc87ab475bb9dd8b442d40b08b as hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/f1/b66b61dc87ab475bb9dd8b442d40b08b 2023-02-12 06:03:14,298 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/f1/5ecd0027248444cda169180d9f1fa4fa, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 06:03:14,298 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/f1/b66b61dc87ab475bb9dd8b442d40b08b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 06:03:14,299 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/.tmp/f2/85d74dd407604825ab015d4371bbda74 as hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/f2/85d74dd407604825ab015d4371bbda74 2023-02-12 06:03:14,299 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/.tmp/f2/6c20a7b29b8443c78c81ef9262cf1e09 as hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/f2/6c20a7b29b8443c78c81ef9262cf1e09 2023-02-12 06:03:14,304 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/.tmp/f2/7997c088a92b4745b8258b963575b023 2023-02-12 06:03:14,306 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/f2/6c20a7b29b8443c78c81ef9262cf1e09, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 06:03:14,307 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for c7a9336f8bb0a79325c1dfbd145f634b in 147ms, sequenceid=5, compaction requested=false 2023-02-12 06:03:14,309 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for c7a9336f8bb0a79325c1dfbd145f634b: 2023-02-12 06:03:14,309 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,309 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 06:03:14,309 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/f1/5ecd0027248444cda169180d9f1fa4fa] hfiles 2023-02-12 06:03:14,309 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/f1/5ecd0027248444cda169180d9f1fa4fa for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,309 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/f2/6c20a7b29b8443c78c81ef9262cf1e09] hfiles 2023-02-12 06:03:14,309 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/f2/6c20a7b29b8443c78c81ef9262cf1e09 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,314 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/f2/85d74dd407604825ab015d4371bbda74, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 06:03:14,315 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 85f78445f74da16716afdb76512ecb80 in 154ms, sequenceid=5, compaction requested=false 2023-02-12 06:03:14,315 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 85f78445f74da16716afdb76512ecb80: 2023-02-12 06:03:14,315 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,315 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 06:03:14,315 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/f1/b66b61dc87ab475bb9dd8b442d40b08b] hfiles 2023-02-12 06:03:14,315 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/f1/b66b61dc87ab475bb9dd8b442d40b08b for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,315 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/f2/85d74dd407604825ab015d4371bbda74] hfiles 2023-02-12 06:03:14,315 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/f2/85d74dd407604825ab015d4371bbda74 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,320 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/.tmp/f2/24d7a82e17e14f00ae6634dfb4a31d0c 2023-02-12 06:03:14,330 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/.tmp/f1/6a40b939d810444db0b9ae1c7bda56e7 as hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/f1/6a40b939d810444db0b9ae1c7bda56e7 2023-02-12 06:03:14,331 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/.tmp/f1/c6eaf0a2e96540d09d8a3b25e52ac0a5 as hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/f1/c6eaf0a2e96540d09d8a3b25e52ac0a5 2023-02-12 06:03:14,336 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/f1/6a40b939d810444db0b9ae1c7bda56e7, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 06:03:14,336 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d. completed. 2023-02-12 06:03:14,336 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d. 2023-02-12 06:03:14,336 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc. 2023-02-12 06:03:14,336 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc. started... 2023-02-12 06:03:14,336 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-12 06:03:14,338 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 3f09441dd1b0444e613ff01a617719fc 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-12 06:03:14,341 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/.tmp/f2/7997c088a92b4745b8258b963575b023 as hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/f2/7997c088a92b4745b8258b963575b023 2023-02-12 06:03:14,341 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/f1/c6eaf0a2e96540d09d8a3b25e52ac0a5, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 06:03:14,342 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/.tmp/f2/737f282067b74816baf7532822744639 2023-02-12 06:03:14,342 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/.tmp/f2/24d7a82e17e14f00ae6634dfb4a31d0c as hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/f2/24d7a82e17e14f00ae6634dfb4a31d0c 2023-02-12 06:03:14,346 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b. completed. 2023-02-12 06:03:14,347 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b. 2023-02-12 06:03:14,347 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-12 06:03:14,347 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80. completed. 2023-02-12 06:03:14,347 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80. 2023-02-12 06:03:14,347 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819. 2023-02-12 06:03:14,347 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-12 06:03:14,347 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819. started... 2023-02-12 06:03:14,348 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 1427e4a55ff7e244357b88ef84871819 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-12 06:03:14,349 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/f2/7997c088a92b4745b8258b963575b023, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 06:03:14,349 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/.tmp/f1/7e0d41db2f15422f99136a86786ad9c7 as hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/f1/7e0d41db2f15422f99136a86786ad9c7 2023-02-12 06:03:14,350 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/f2/24d7a82e17e14f00ae6634dfb4a31d0c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 06:03:14,350 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 77a828f6a35d46d6316183425b87ba6d in 190ms, sequenceid=5, compaction requested=false 2023-02-12 06:03:14,351 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 77a828f6a35d46d6316183425b87ba6d: 2023-02-12 06:03:14,351 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,351 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 06:03:14,351 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/f1/6a40b939d810444db0b9ae1c7bda56e7] hfiles 2023-02-12 06:03:14,351 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/f1/6a40b939d810444db0b9ae1c7bda56e7 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,351 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/f2/7997c088a92b4745b8258b963575b023] hfiles 2023-02-12 06:03:14,351 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/f2/7997c088a92b4745b8258b963575b023 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,351 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 133d67c01c34b4394253d055b1241449 in 154ms, sequenceid=5, compaction requested=false 2023-02-12 06:03:14,351 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 133d67c01c34b4394253d055b1241449: 2023-02-12 06:03:14,351 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676181792831.133d67c01c34b4394253d055b1241449.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,351 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 06:03:14,351 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/f1/c6eaf0a2e96540d09d8a3b25e52ac0a5] hfiles 2023-02-12 06:03:14,352 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/f1/c6eaf0a2e96540d09d8a3b25e52ac0a5 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,352 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/f2/24d7a82e17e14f00ae6634dfb4a31d0c] hfiles 2023-02-12 06:03:14,352 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/f2/24d7a82e17e14f00ae6634dfb4a31d0c for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,356 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/f1/7e0d41db2f15422f99136a86786ad9c7, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 06:03:14,357 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/.tmp/f2/737f282067b74816baf7532822744639 as hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/f2/737f282067b74816baf7532822744639 2023-02-12 06:03:14,363 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/f2/737f282067b74816baf7532822744639, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 06:03:14,364 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 76756473478f2c8afca1ab066347a4a0 in 167ms, sequenceid=5, compaction requested=false 2023-02-12 06:03:14,364 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 76756473478f2c8afca1ab066347a4a0: 2023-02-12 06:03:14,364 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,364 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 06:03:14,365 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/f1/7e0d41db2f15422f99136a86786ad9c7] hfiles 2023-02-12 06:03:14,365 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/f1/7e0d41db2f15422f99136a86786ad9c7 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,365 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/f2/737f282067b74816baf7532822744639] hfiles 2023-02-12 06:03:14,365 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/f2/737f282067b74816baf7532822744639 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,368 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/.tmp/f1/05a3907316834a66b9d2a4a881c4a24c 2023-02-12 06:03:14,391 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/.tmp/f1/1959035159db463d8630aad23b311c80 2023-02-12 06:03:14,398 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0. completed. 2023-02-12 06:03:14,398 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0. 2023-02-12 06:03:14,398 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d. completed. 2023-02-12 06:03:14,398 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d. 2023-02-12 06:03:14,398 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-12 06:03:14,398 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-12 06:03:14,414 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/.tmp/f2/bbe96aa49e0a4b26ac1eaad6e50d9b95 2023-02-12 06:03:14,420 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/.tmp/f1/05a3907316834a66b9d2a4a881c4a24c as hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/f1/05a3907316834a66b9d2a4a881c4a24c 2023-02-12 06:03:14,425 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/f1/05a3907316834a66b9d2a4a881c4a24c, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 06:03:14,425 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/.tmp/f2/bbe96aa49e0a4b26ac1eaad6e50d9b95 as hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/f2/bbe96aa49e0a4b26ac1eaad6e50d9b95 2023-02-12 06:03:14,429 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/.tmp/f2/f777697bc6e84cc6a9aef92bd477a0eb 2023-02-12 06:03:14,430 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/f2/bbe96aa49e0a4b26ac1eaad6e50d9b95, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-12 06:03:14,431 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 3f09441dd1b0444e613ff01a617719fc in 94ms, sequenceid=5, compaction requested=false 2023-02-12 06:03:14,431 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 3f09441dd1b0444e613ff01a617719fc: 2023-02-12 06:03:14,431 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,431 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 06:03:14,431 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/f1/05a3907316834a66b9d2a4a881c4a24c] hfiles 2023-02-12 06:03:14,431 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/f1/05a3907316834a66b9d2a4a881c4a24c for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,432 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/f2/bbe96aa49e0a4b26ac1eaad6e50d9b95] hfiles 2023-02-12 06:03:14,432 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/f2/bbe96aa49e0a4b26ac1eaad6e50d9b95 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,432 DEBUG [Listener at localhost/46353] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 06:03:14,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-12 06:03:14,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-12 06:03:14,434 DEBUG [Listener at localhost/46353] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-12 06:03:14,435 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/.tmp/f1/1959035159db463d8630aad23b311c80 as hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/f1/1959035159db463d8630aad23b311c80 2023-02-12 06:03:14,442 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/f1/1959035159db463d8630aad23b311c80, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 06:03:14,442 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/.tmp/f2/f777697bc6e84cc6a9aef92bd477a0eb as hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/f2/f777697bc6e84cc6a9aef92bd477a0eb 2023-02-12 06:03:14,442 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc. completed. 2023-02-12 06:03:14,442 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc. 2023-02-12 06:03:14,443 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-12 06:03:14,446 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/f2/f777697bc6e84cc6a9aef92bd477a0eb, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-12 06:03:14,447 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 1427e4a55ff7e244357b88ef84871819 in 99ms, sequenceid=5, compaction requested=false 2023-02-12 06:03:14,447 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 1427e4a55ff7e244357b88ef84871819: 2023-02-12 06:03:14,447 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,447 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 06:03:14,447 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/f1/1959035159db463d8630aad23b311c80] hfiles 2023-02-12 06:03:14,447 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/f1/1959035159db463d8630aad23b311c80 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,447 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/f2/f777697bc6e84cc6a9aef92bd477a0eb] hfiles 2023-02-12 06:03:14,447 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/f2/f777697bc6e84cc6a9aef92bd477a0eb for snapshot=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,452 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819. completed. 2023-02-12 06:03:14,452 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819. 2023-02-12 06:03:14,452 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-12 06:03:14,452 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-12 06:03:14,453 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:14,453 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-12 06:03:14,453 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,41035,1676181791508' in zk 2023-02-12 06:03:14,454 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-12 06:03:14,454 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:14,454 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:03:14,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:14,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:14,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 06:03:14,455 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-12 06:03:14,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:14,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:14,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:14,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:14,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:14,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:14,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,41035,1676181791508': 2023-02-12 06:03:14,457 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41035,1676181791508' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-12 06:03:14,734 DEBUG [Listener at localhost/46353] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 06:03:14,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-12 06:03:14,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-12 06:03:14,736 DEBUG [Listener at localhost/46353] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-12 06:03:14,798 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676181792831.133d67c01c34b4394253d055b1241449. completed. 2023-02-12 06:03:14,798 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676181792831.133d67c01c34b4394253d055b1241449. 2023-02-12 06:03:14,798 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-12 06:03:14,798 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-12 06:03:14,798 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:14,798 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-12 06:03:14,798 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,33593,1676181791587' in zk 2023-02-12 06:03:14,800 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:14,800 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-12 06:03:14,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:14,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:14,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 06:03:14,800 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:03:14,800 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-12 06:03:14,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:14,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:14,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:14,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:14,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:14,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:14,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:14,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,33593,1676181791587': 2023-02-12 06:03:14,803 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33593,1676181791587' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-12 06:03:14,803 INFO [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-12 06:03:14,803 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 06:03:14,803 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 06:03:14,803 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,803 INFO [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-12 06:03:14,806 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,806 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): regionserver:33593-0x10047204c7b0002, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:14,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 06:03:14,806 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): regionserver:41035-0x10047204c7b0001, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,806 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): regionserver:33593-0x10047204c7b0002, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 06:03:14,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,806 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): regionserver:41035-0x10047204c7b0001, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 06:03:14,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:14,806 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:14,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 06:03:14,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 06:03:14,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:03:14,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:03:14,807 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:14,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:14,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:14,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:14,812 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:14,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:14,812 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:14,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:14,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:14,817 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:14,817 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): regionserver:41035-0x10047204c7b0001, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 06:03:14,817 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,817 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): regionserver:33593-0x10047204c7b0002, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 06:03:14,817 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:14,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 06:03:14,817 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 06:03:14,818 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:03:14,817 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): regionserver:41035-0x10047204c7b0001, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 06:03:14,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:03:14,818 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,817 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:14,818 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:03:14,817 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): regionserver:33593-0x10047204c7b0002, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 06:03:14,818 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,818 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:14,818 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,818 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 06:03:14,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:03:14,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 06:03:14,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:03:14,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,858 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,877 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-12 06:03:14,877 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,877 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:14,877 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1676181794127Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1676181794818 (+691 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1676181794818Writing data manifest for testWithMockedMapReduceMultiRegion at 1676181794828 (+10 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1676181794845 (+17 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1676181794877 (+32 ms) 2023-02-12 06:03:14,879 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-12 06:03:14,880 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 751 msec 2023-02-12 06:03:15,236 DEBUG [Listener at localhost/46353] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 06:03:15,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-12 06:03:15,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-12 06:03:15,237 INFO [Listener at localhost/46353] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-12 06:03:15,241 INFO [Listener at localhost/46353] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-12 06:03:15,247 INFO [Listener at localhost/46353] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-12 06:03:15,270 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33593] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b. 2023-02-12 06:03:15,272 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41035] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 8788 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80. 2023-02-12 06:03:15,358 INFO [Listener at localhost/46353] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-12 06:03:15,365 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-12 06:03:15,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,368 INFO [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-12 06:03:15,368 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 06:03:15,368 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-12 06:03:15,368 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-12 06:03:15,369 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,369 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,370 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): regionserver:41035-0x10047204c7b0001, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 06:03:15,370 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): regionserver:33593-0x10047204c7b0002, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 06:03:15,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 06:03:15,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 06:03:15,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:03:15,370 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:15,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:03:15,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,371 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:15,371 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:15,371 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33593-0x10047204c7b0002, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,371 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41035-0x10047204c7b0001, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,371 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:15,371 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 06:03:15,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 06:03:15,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,372 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 06:03:15,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,372 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,372 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,372 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-12 06:03:15,372 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 06:03:15,372 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,373 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-12 06:03:15,373 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-12 06:03:15,373 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 06:03:15,373 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d. 2023-02-12 06:03:15,373 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b. 2023-02-12 06:03:15,374 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d. started... 2023-02-12 06:03:15,374 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e. 2023-02-12 06:03:15,374 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-12 06:03:15,374 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-12 06:03:15,374 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 06:03:15,374 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 36c2a20d70c505da7da65238cdb01a2d 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 06:03:15,374 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e. started... 2023-02-12 06:03:15,374 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80. 2023-02-12 06:03:15,374 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-12 06:03:15,374 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 06:03:15,374 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b. started... 2023-02-12 06:03:15,374 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b. 2023-02-12 06:03:15,374 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b. started... 2023-02-12 06:03:15,374 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80. started... 2023-02-12 06:03:15,374 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 530f05fe8dbd50117feed5e471b6c59e: 2023-02-12 06:03:15,374 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d. 2023-02-12 06:03:15,374 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d. started... 2023-02-12 06:03:15,374 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 85f78445f74da16716afdb76512ecb80 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 06:03:15,374 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 77a828f6a35d46d6316183425b87ba6d 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 06:03:15,374 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e. 2023-02-12 06:03:15,374 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for c9e3aa687caae91031a86b0af14dbc7b: 2023-02-12 06:03:15,375 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-12 06:03:15,374 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing c7a9336f8bb0a79325c1dfbd145f634b 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-12 06:03:15,375 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b. 2023-02-12 06:03:15,375 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676181792831.133d67c01c34b4394253d055b1241449. 2023-02-12 06:03:15,375 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0. 2023-02-12 06:03:15,376 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-12 06:03:15,375 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1676181792831.133d67c01c34b4394253d055b1241449. started... 2023-02-12 06:03:15,376 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0. started... 2023-02-12 06:03:15,376 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 133d67c01c34b4394253d055b1241449 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 06:03:15,376 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 76756473478f2c8afca1ab066347a4a0 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 06:03:15,416 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/.tmp/f1/06a9683daae0462fa2912dbc5f07461e 2023-02-12 06:03:15,417 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/.tmp/f1/46b3fb1c61ff4dbabeaf2a6f48515640 2023-02-12 06:03:15,419 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/.tmp/f1/176237e658ce4e5c90cab7f6350fc968 2023-02-12 06:03:15,424 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/.tmp/f1/057bca0e14364bdaadbce066f8ada43e 2023-02-12 06:03:15,427 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/.tmp/f1/8bcd7cf3a2f04c4cacb1fa285bc0a24b 2023-02-12 06:03:15,461 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/.tmp/f2/f33681d6fa4f442daf16d37a3d7b3231 2023-02-12 06:03:15,461 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/.tmp/f2/71ce04a481d64ffd9faf486130c88898 2023-02-12 06:03:15,463 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/.tmp/f2/7b61b08e69884f55b7fc4527f7a19f41 2023-02-12 06:03:15,465 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/.tmp/f2/2b48ed4a8ba440e499627f94d9da10e5 2023-02-12 06:03:15,468 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/.tmp/f1/176237e658ce4e5c90cab7f6350fc968 as hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/f1/176237e658ce4e5c90cab7f6350fc968 2023-02-12 06:03:15,473 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/.tmp/f1/46b3fb1c61ff4dbabeaf2a6f48515640 as hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/f1/46b3fb1c61ff4dbabeaf2a6f48515640 2023-02-12 06:03:15,475 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/.tmp/f1/06a9683daae0462fa2912dbc5f07461e as hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/f1/06a9683daae0462fa2912dbc5f07461e 2023-02-12 06:03:15,477 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/.tmp/f1/8bcd7cf3a2f04c4cacb1fa285bc0a24b as hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/f1/8bcd7cf3a2f04c4cacb1fa285bc0a24b 2023-02-12 06:03:15,478 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/f1/46b3fb1c61ff4dbabeaf2a6f48515640, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 06:03:15,480 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/f1/06a9683daae0462fa2912dbc5f07461e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 06:03:15,480 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/.tmp/f2/71ce04a481d64ffd9faf486130c88898 as hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/f2/71ce04a481d64ffd9faf486130c88898 2023-02-12 06:03:15,481 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/.tmp/f2/7b61b08e69884f55b7fc4527f7a19f41 as hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/f2/7b61b08e69884f55b7fc4527f7a19f41 2023-02-12 06:03:15,491 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/f1/8bcd7cf3a2f04c4cacb1fa285bc0a24b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 06:03:15,492 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/f1/176237e658ce4e5c90cab7f6350fc968, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 06:03:15,492 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/.tmp/f2/2b48ed4a8ba440e499627f94d9da10e5 as hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/f2/2b48ed4a8ba440e499627f94d9da10e5 2023-02-12 06:03:15,492 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/.tmp/f2/f33681d6fa4f442daf16d37a3d7b3231 as hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/f2/f33681d6fa4f442daf16d37a3d7b3231 2023-02-12 06:03:15,494 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/f2/71ce04a481d64ffd9faf486130c88898, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 06:03:15,495 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/f2/7b61b08e69884f55b7fc4527f7a19f41, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 06:03:15,495 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 77a828f6a35d46d6316183425b87ba6d in 121ms, sequenceid=9, compaction requested=false 2023-02-12 06:03:15,495 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 85f78445f74da16716afdb76512ecb80 in 121ms, sequenceid=9, compaction requested=false 2023-02-12 06:03:15,495 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 77a828f6a35d46d6316183425b87ba6d: 2023-02-12 06:03:15,495 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 85f78445f74da16716afdb76512ecb80: 2023-02-12 06:03:15,495 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d. 2023-02-12 06:03:15,496 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80. 2023-02-12 06:03:15,496 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819. 2023-02-12 06:03:15,496 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-12 06:03:15,496 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-12 06:03:15,496 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819. started... 2023-02-12 06:03:15,496 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1427e4a55ff7e244357b88ef84871819 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-12 06:03:15,501 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/f2/f33681d6fa4f442daf16d37a3d7b3231, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 06:03:15,502 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 133d67c01c34b4394253d055b1241449 in 126ms, sequenceid=9, compaction requested=false 2023-02-12 06:03:15,502 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 133d67c01c34b4394253d055b1241449: 2023-02-12 06:03:15,502 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676181792831.133d67c01c34b4394253d055b1241449. 2023-02-12 06:03:15,502 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc. 2023-02-12 06:03:15,502 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc. started... 2023-02-12 06:03:15,502 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 3f09441dd1b0444e613ff01a617719fc 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-12 06:03:15,504 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-12 06:03:15,505 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/f2/2b48ed4a8ba440e499627f94d9da10e5, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 06:03:15,506 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 36c2a20d70c505da7da65238cdb01a2d in 132ms, sequenceid=9, compaction requested=false 2023-02-12 06:03:15,506 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 36c2a20d70c505da7da65238cdb01a2d: 2023-02-12 06:03:15,506 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d. 2023-02-12 06:03:15,507 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-12 06:03:15,516 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/.tmp/f1/24fabd0d558441909781aabad3a096d5 2023-02-12 06:03:15,540 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/.tmp/f1/3af97bbcb8874ab797081d2e066c1b88 2023-02-12 06:03:15,552 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/.tmp/f2/75030c1c6df14e6ebfdfb0c0ecb4b0c6 2023-02-12 06:03:15,556 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/.tmp/f1/24fabd0d558441909781aabad3a096d5 as hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/f1/24fabd0d558441909781aabad3a096d5 2023-02-12 06:03:15,560 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/f1/24fabd0d558441909781aabad3a096d5, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 06:03:15,561 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/.tmp/f2/75030c1c6df14e6ebfdfb0c0ecb4b0c6 as hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/f2/75030c1c6df14e6ebfdfb0c0ecb4b0c6 2023-02-12 06:03:15,566 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/.tmp/f2/d536f1d0a53a4c5886641fa90a7f1417 2023-02-12 06:03:15,566 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/f2/75030c1c6df14e6ebfdfb0c0ecb4b0c6, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 06:03:15,567 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 1427e4a55ff7e244357b88ef84871819 in 71ms, sequenceid=9, compaction requested=false 2023-02-12 06:03:15,567 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1427e4a55ff7e244357b88ef84871819: 2023-02-12 06:03:15,567 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819. 2023-02-12 06:03:15,567 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-12 06:03:15,570 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/.tmp/f1/3af97bbcb8874ab797081d2e066c1b88 as hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/f1/3af97bbcb8874ab797081d2e066c1b88 2023-02-12 06:03:15,573 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/f1/3af97bbcb8874ab797081d2e066c1b88, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 06:03:15,574 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/.tmp/f2/d536f1d0a53a4c5886641fa90a7f1417 as hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/f2/d536f1d0a53a4c5886641fa90a7f1417 2023-02-12 06:03:15,578 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/f2/d536f1d0a53a4c5886641fa90a7f1417, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 06:03:15,578 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 3f09441dd1b0444e613ff01a617719fc in 76ms, sequenceid=9, compaction requested=false 2023-02-12 06:03:15,579 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 3f09441dd1b0444e613ff01a617719fc: 2023-02-12 06:03:15,579 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc. 2023-02-12 06:03:15,579 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-12 06:03:15,825 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/.tmp/f1/328d727c31ee467cbf673aa9e49d5765 2023-02-12 06:03:15,838 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/.tmp/f2/3f364f7b2fe14196baefa760efe65d74 2023-02-12 06:03:15,842 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/.tmp/f1/328d727c31ee467cbf673aa9e49d5765 as hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/f1/328d727c31ee467cbf673aa9e49d5765 2023-02-12 06:03:15,846 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/f1/328d727c31ee467cbf673aa9e49d5765, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 06:03:15,847 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/.tmp/f2/3f364f7b2fe14196baefa760efe65d74 as hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/f2/3f364f7b2fe14196baefa760efe65d74 2023-02-12 06:03:15,851 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/f2/3f364f7b2fe14196baefa760efe65d74, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-12 06:03:15,852 INFO [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 76756473478f2c8afca1ab066347a4a0 in 476ms, sequenceid=9, compaction requested=false 2023-02-12 06:03:15,852 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 76756473478f2c8afca1ab066347a4a0: 2023-02-12 06:03:15,852 DEBUG [rs(jenkins-hbase4.apache.org,41035,1676181791508)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0. 2023-02-12 06:03:15,852 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-12 06:03:15,853 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-12 06:03:15,853 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:15,853 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-12 06:03:15,853 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41035,1676181791508' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-12 06:03:15,855 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,855 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:15,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:15,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:15,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 06:03:15,856 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41035-0x10047204c7b0001, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,856 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 06:03:15,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:15,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:15,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:15,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:15,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41035,1676181791508' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-12 06:03:15,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23eb9fe0[Count = 1] remaining members to acquire global barrier 2023-02-12 06:03:15,864 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/.tmp/f2/4ac61190eb85409a8475ab4ad9e685f6 2023-02-12 06:03:15,869 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/.tmp/f1/057bca0e14364bdaadbce066f8ada43e as hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/f1/057bca0e14364bdaadbce066f8ada43e 2023-02-12 06:03:15,874 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/f1/057bca0e14364bdaadbce066f8ada43e, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 06:03:15,875 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/.tmp/f2/4ac61190eb85409a8475ab4ad9e685f6 as hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/f2/4ac61190eb85409a8475ab4ad9e685f6 2023-02-12 06:03:15,879 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/f2/4ac61190eb85409a8475ab4ad9e685f6, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-12 06:03:15,879 INFO [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for c7a9336f8bb0a79325c1dfbd145f634b in 505ms, sequenceid=9, compaction requested=false 2023-02-12 06:03:15,879 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for c7a9336f8bb0a79325c1dfbd145f634b: 2023-02-12 06:03:15,879 DEBUG [rs(jenkins-hbase4.apache.org,33593,1676181791587)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b. 2023-02-12 06:03:15,880 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-12 06:03:15,880 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-12 06:03:15,880 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:15,880 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-12 06:03:15,880 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33593,1676181791587' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-12 06:03:15,881 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,881 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:15,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:15,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:15,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 06:03:15,882 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33593-0x10047204c7b0002, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,882 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 06:03:15,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:15,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:15,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:15,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:15,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:15,883 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33593,1676181791587' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-12 06:03:15,883 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23eb9fe0[Count = 0] remaining members to acquire global barrier 2023-02-12 06:03:15,883 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-12 06:03:15,883 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,885 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): regionserver:33593-0x10047204c7b0002, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,885 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): regionserver:41035-0x10047204c7b0001, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,885 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:15,885 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-12 06:03:15,885 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-12 06:03:15,885 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-12 06:03:15,885 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-12 06:03:15,885 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,33593,1676181791587' in zk 2023-02-12 06:03:15,885 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,41035,1676181791508' in zk 2023-02-12 06:03:15,886 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:15,886 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 06:03:15,887 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:15,887 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-12 06:03:15,887 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:15,887 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-12 06:03:15,887 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:03:15,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:15,887 DEBUG [member: 'jenkins-hbase4.apache.org,41035,1676181791508' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-12 06:03:15,887 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:03:15,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:15,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 06:03:15,887 DEBUG [member: 'jenkins-hbase4.apache.org,33593,1676181791587' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-12 06:03:15,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:15,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:15,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:15,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:15,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:15,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:15,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:15,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,33593,1676181791587': 2023-02-12 06:03:15,890 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33593,1676181791587' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-12 06:03:15,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:15,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:15,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 06:03:15,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:15,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:15,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:15,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:15,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:15,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:15,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:15,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,41035,1676181791508': 2023-02-12 06:03:15,892 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41035,1676181791508' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-12 06:03:15,892 INFO [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-12 06:03:15,892 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 06:03:15,892 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 06:03:15,892 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,892 INFO [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 06:03:15,895 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,895 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): regionserver:41035-0x10047204c7b0001, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:15,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 06:03:15,895 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): regionserver:33593-0x10047204c7b0002, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,895 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): regionserver:33593-0x10047204c7b0002, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 06:03:15,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,895 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): regionserver:41035-0x10047204c7b0001, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 06:03:15,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:15,896 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:15,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 06:03:15,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:03:15,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 06:03:15,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:03:15,896 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:15,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:15,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:15,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:15,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:15,897 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:15,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,898 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:15,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:15,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:15,900 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:15,900 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): regionserver:41035-0x10047204c7b0001, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 06:03:15,900 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 06:03:15,900 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): regionserver:41035-0x10047204c7b0001, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 06:03:15,900 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): regionserver:33593-0x10047204c7b0002, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 06:03:15,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:03:15,901 DEBUG [(jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:03:15,901 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-12 06:03:15,901 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 06:03:15,900 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:15,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 06:03:15,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:03:15,900 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): regionserver:33593-0x10047204c7b0002, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 06:03:15,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 06:03:15,901 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:03:15,901 DEBUG [Listener at localhost/46353] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-12 06:03:15,901 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:15,901 DEBUG [Listener at localhost/46353] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 06:03:15,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 06:03:15,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:03:15,901 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,901 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:15,901 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:15,901 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:16,001 DEBUG [Listener at localhost/46353] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 06:03:16,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 06:03:16,007 INFO [Listener at localhost/46353] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676181794106 type: FLUSH version: 2 ttl: 0 2023-02-12 06:03:16,007 DEBUG [Listener at localhost/46353] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5/data/default/testWithMockedMapReduceMultiRegion 2023-02-12 06:03:16,008 INFO [Listener at localhost/46353] snapshot.RestoreSnapshotHelper(239): region to add: 77a828f6a35d46d6316183425b87ba6d 2023-02-12 06:03:16,008 INFO [Listener at localhost/46353] snapshot.RestoreSnapshotHelper(239): region to add: 36c2a20d70c505da7da65238cdb01a2d 2023-02-12 06:03:16,008 INFO [Listener at localhost/46353] snapshot.RestoreSnapshotHelper(239): region to add: c9e3aa687caae91031a86b0af14dbc7b 2023-02-12 06:03:16,008 INFO [Listener at localhost/46353] snapshot.RestoreSnapshotHelper(239): region to add: 85f78445f74da16716afdb76512ecb80 2023-02-12 06:03:16,008 INFO [Listener at localhost/46353] snapshot.RestoreSnapshotHelper(239): region to add: c7a9336f8bb0a79325c1dfbd145f634b 2023-02-12 06:03:16,008 INFO [Listener at localhost/46353] snapshot.RestoreSnapshotHelper(239): region to add: 530f05fe8dbd50117feed5e471b6c59e 2023-02-12 06:03:16,008 INFO [Listener at localhost/46353] snapshot.RestoreSnapshotHelper(239): region to add: 76756473478f2c8afca1ab066347a4a0 2023-02-12 06:03:16,008 INFO [Listener at localhost/46353] snapshot.RestoreSnapshotHelper(239): region to add: 133d67c01c34b4394253d055b1241449 2023-02-12 06:03:16,008 INFO [Listener at localhost/46353] snapshot.RestoreSnapshotHelper(239): region to add: 1427e4a55ff7e244357b88ef84871819 2023-02-12 06:03:16,008 INFO [Listener at localhost/46353] snapshot.RestoreSnapshotHelper(239): region to add: 3f09441dd1b0444e613ff01a617719fc 2023-02-12 06:03:16,008 INFO [Listener at localhost/46353] snapshot.RestoreSnapshotHelper(585): clone region=77a828f6a35d46d6316183425b87ba6d as 77a828f6a35d46d6316183425b87ba6d in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 06:03:16,008 INFO [Listener at localhost/46353] snapshot.RestoreSnapshotHelper(585): clone region=36c2a20d70c505da7da65238cdb01a2d as 36c2a20d70c505da7da65238cdb01a2d in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 06:03:16,009 INFO [Listener at localhost/46353] snapshot.RestoreSnapshotHelper(585): clone region=c9e3aa687caae91031a86b0af14dbc7b as c9e3aa687caae91031a86b0af14dbc7b in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 06:03:16,009 INFO [Listener at localhost/46353] snapshot.RestoreSnapshotHelper(585): clone region=85f78445f74da16716afdb76512ecb80 as 85f78445f74da16716afdb76512ecb80 in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 06:03:16,009 INFO [Listener at localhost/46353] snapshot.RestoreSnapshotHelper(585): clone region=c7a9336f8bb0a79325c1dfbd145f634b as c7a9336f8bb0a79325c1dfbd145f634b in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 06:03:16,009 INFO [Listener at localhost/46353] snapshot.RestoreSnapshotHelper(585): clone region=530f05fe8dbd50117feed5e471b6c59e as 530f05fe8dbd50117feed5e471b6c59e in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 06:03:16,009 INFO [Listener at localhost/46353] snapshot.RestoreSnapshotHelper(585): clone region=76756473478f2c8afca1ab066347a4a0 as 76756473478f2c8afca1ab066347a4a0 in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 06:03:16,009 INFO [Listener at localhost/46353] snapshot.RestoreSnapshotHelper(585): clone region=133d67c01c34b4394253d055b1241449 as 133d67c01c34b4394253d055b1241449 in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 06:03:16,009 INFO [Listener at localhost/46353] snapshot.RestoreSnapshotHelper(585): clone region=1427e4a55ff7e244357b88ef84871819 as 1427e4a55ff7e244357b88ef84871819 in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 06:03:16,009 INFO [Listener at localhost/46353] snapshot.RestoreSnapshotHelper(585): clone region=3f09441dd1b0444e613ff01a617719fc as 3f09441dd1b0444e613ff01a617719fc in snapshot testWithMockedMapReduceMultiRegion 2023-02-12 06:03:16,010 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 133d67c01c34b4394253d055b1241449, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676181792831.133d67c01c34b4394253d055b1241449.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5 2023-02-12 06:03:16,010 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 76756473478f2c8afca1ab066347a4a0, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5 2023-02-12 06:03:16,011 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 77a828f6a35d46d6316183425b87ba6d, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5 2023-02-12 06:03:16,011 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 530f05fe8dbd50117feed5e471b6c59e, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5 2023-02-12 06:03:16,011 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 85f78445f74da16716afdb76512ecb80, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5 2023-02-12 06:03:16,012 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => 36c2a20d70c505da7da65238cdb01a2d, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5 2023-02-12 06:03:16,012 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => c9e3aa687caae91031a86b0af14dbc7b, NAME => 'testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5 2023-02-12 06:03:16,012 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => c7a9336f8bb0a79325c1dfbd145f634b, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5 2023-02-12 06:03:16,037 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:16,037 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5ecd0027248444cda169180d9f1fa4fa from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:16,041 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6c20a7b29b8443c78c81ef9262cf1e09 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:16,049 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:16,049 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink df193a96811949fea9c667f090d8daed from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:16,060 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing c7a9336f8bb0a79325c1dfbd145f634b, disabling compactions & flushes 2023-02-12 06:03:16,060 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:16,060 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 530f05fe8dbd50117feed5e471b6c59e, disabling compactions & flushes 2023-02-12 06:03:16,060 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e. 2023-02-12 06:03:16,060 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e. 2023-02-12 06:03:16,060 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e. after waiting 0 ms 2023-02-12 06:03:16,060 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e. 2023-02-12 06:03:16,060 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b. 2023-02-12 06:03:16,061 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b. 2023-02-12 06:03:16,061 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b. after waiting 0 ms 2023-02-12 06:03:16,061 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b. 2023-02-12 06:03:16,061 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b. 2023-02-12 06:03:16,061 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for c7a9336f8bb0a79325c1dfbd145f634b: Waiting for close lock at 1676181796060Disabling compacts and flushes for region at 1676181796060Disabling writes for close at 1676181796061 (+1 ms)Writing region close event to WAL at 1676181796061Closed at 1676181796061 2023-02-12 06:03:16,061 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 1427e4a55ff7e244357b88ef84871819, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5 2023-02-12 06:03:16,062 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:16,062 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7e0d41db2f15422f99136a86786ad9c7 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:16,061 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e. 2023-02-12 06:03:16,062 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 530f05fe8dbd50117feed5e471b6c59e: Waiting for close lock at 1676181796060Disabling compacts and flushes for region at 1676181796060Disabling writes for close at 1676181796060Writing region close event to WAL at 1676181796061 (+1 ms)Closed at 1676181796061 2023-02-12 06:03:16,063 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 3f09441dd1b0444e613ff01a617719fc, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5 2023-02-12 06:03:16,063 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8755b9d62b29447a88c673100ec1fe73 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:16,064 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676181792831.133d67c01c34b4394253d055b1241449.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:16,064 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c6eaf0a2e96540d09d8a3b25e52ac0a5 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:16,065 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:16,065 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:16,065 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 6a40b939d810444db0b9ae1c7bda56e7 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:16,065 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing c9e3aa687caae91031a86b0af14dbc7b, disabling compactions & flushes 2023-02-12 06:03:16,065 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b. 2023-02-12 06:03:16,065 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b. 2023-02-12 06:03:16,065 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b. after waiting 0 ms 2023-02-12 06:03:16,065 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b. 2023-02-12 06:03:16,065 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b. 2023-02-12 06:03:16,065 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for c9e3aa687caae91031a86b0af14dbc7b: Waiting for close lock at 1676181796065Disabling compacts and flushes for region at 1676181796065Disabling writes for close at 1676181796065Writing region close event to WAL at 1676181796065Closed at 1676181796065 2023-02-12 06:03:16,068 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:16,068 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b66b61dc87ab475bb9dd8b442d40b08b from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:16,076 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing 36c2a20d70c505da7da65238cdb01a2d, disabling compactions & flushes 2023-02-12 06:03:16,076 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d. 2023-02-12 06:03:16,076 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d. 2023-02-12 06:03:16,076 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d. after waiting 0 ms 2023-02-12 06:03:16,076 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d. 2023-02-12 06:03:16,076 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d. 2023-02-12 06:03:16,077 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for 36c2a20d70c505da7da65238cdb01a2d: Waiting for close lock at 1676181796076Disabling compacts and flushes for region at 1676181796076Disabling writes for close at 1676181796076Writing region close event to WAL at 1676181796076Closed at 1676181796076 2023-02-12 06:03:16,077 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 24d7a82e17e14f00ae6634dfb4a31d0c from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:16,077 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 737f282067b74816baf7532822744639 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:16,078 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7997c088a92b4745b8258b963575b023 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:16,085 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 77a828f6a35d46d6316183425b87ba6d, disabling compactions & flushes 2023-02-12 06:03:16,085 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d. 2023-02-12 06:03:16,085 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d. 2023-02-12 06:03:16,085 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d. after waiting 0 ms 2023-02-12 06:03:16,085 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d. 2023-02-12 06:03:16,085 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d. 2023-02-12 06:03:16,085 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 77a828f6a35d46d6316183425b87ba6d: Waiting for close lock at 1676181796085Disabling compacts and flushes for region at 1676181796085Disabling writes for close at 1676181796085Writing region close event to WAL at 1676181796085Closed at 1676181796085 2023-02-12 06:03:16,089 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 133d67c01c34b4394253d055b1241449, disabling compactions & flushes 2023-02-12 06:03:16,089 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676181792831.133d67c01c34b4394253d055b1241449. 2023-02-12 06:03:16,089 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 76756473478f2c8afca1ab066347a4a0, disabling compactions & flushes 2023-02-12 06:03:16,089 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676181792831.133d67c01c34b4394253d055b1241449. 2023-02-12 06:03:16,089 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0. 2023-02-12 06:03:16,089 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0. 2023-02-12 06:03:16,089 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0. after waiting 0 ms 2023-02-12 06:03:16,089 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0. 2023-02-12 06:03:16,089 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0. 2023-02-12 06:03:16,089 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 76756473478f2c8afca1ab066347a4a0: Waiting for close lock at 1676181796089Disabling compacts and flushes for region at 1676181796089Disabling writes for close at 1676181796089Writing region close event to WAL at 1676181796089Closed at 1676181796089 2023-02-12 06:03:16,089 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676181792831.133d67c01c34b4394253d055b1241449. after waiting 0 ms 2023-02-12 06:03:16,089 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676181792831.133d67c01c34b4394253d055b1241449. 2023-02-12 06:03:16,090 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676181792831.133d67c01c34b4394253d055b1241449. 2023-02-12 06:03:16,090 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 133d67c01c34b4394253d055b1241449: Waiting for close lock at 1676181796089Disabling compacts and flushes for region at 1676181796089Disabling writes for close at 1676181796089Writing region close event to WAL at 1676181796089Closed at 1676181796089 2023-02-12 06:03:16,095 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 85d74dd407604825ab015d4371bbda74 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:16,097 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:16,097 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1959035159db463d8630aad23b311c80 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:16,098 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:16,098 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 05a3907316834a66b9d2a4a881c4a24c from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:16,101 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f777697bc6e84cc6a9aef92bd477a0eb from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:16,101 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 85f78445f74da16716afdb76512ecb80, disabling compactions & flushes 2023-02-12 06:03:16,101 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bbe96aa49e0a4b26ac1eaad6e50d9b95 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:16,101 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80. 2023-02-12 06:03:16,101 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80. 2023-02-12 06:03:16,101 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80. after waiting 0 ms 2023-02-12 06:03:16,101 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80. 2023-02-12 06:03:16,101 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80. 2023-02-12 06:03:16,101 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 85f78445f74da16716afdb76512ecb80: Waiting for close lock at 1676181796101Disabling compacts and flushes for region at 1676181796101Disabling writes for close at 1676181796101Writing region close event to WAL at 1676181796101Closed at 1676181796101 2023-02-12 06:03:16,103 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 1427e4a55ff7e244357b88ef84871819, disabling compactions & flushes 2023-02-12 06:03:16,103 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 3f09441dd1b0444e613ff01a617719fc, disabling compactions & flushes 2023-02-12 06:03:16,103 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819. 2023-02-12 06:03:16,103 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc. 2023-02-12 06:03:16,103 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819. 2023-02-12 06:03:16,103 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc. 2023-02-12 06:03:16,103 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819. after waiting 0 ms 2023-02-12 06:03:16,103 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc. after waiting 0 ms 2023-02-12 06:03:16,103 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819. 2023-02-12 06:03:16,103 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc. 2023-02-12 06:03:16,103 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819. 2023-02-12 06:03:16,103 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc. 2023-02-12 06:03:16,103 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 1427e4a55ff7e244357b88ef84871819: Waiting for close lock at 1676181796103Disabling compacts and flushes for region at 1676181796103Disabling writes for close at 1676181796103Writing region close event to WAL at 1676181796103Closed at 1676181796103 2023-02-12 06:03:16,103 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 3f09441dd1b0444e613ff01a617719fc: Waiting for close lock at 1676181796103Disabling compacts and flushes for region at 1676181796103Disabling writes for close at 1676181796103Writing region close event to WAL at 1676181796103Closed at 1676181796103 2023-02-12 06:03:16,104 INFO [Listener at localhost/46353] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676181794106 type: FLUSH version: 2 ttl: 0 2023-02-12 06:03:16,104 DEBUG [Listener at localhost/46353] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5 2023-02-12 06:03:16,104 DEBUG [Listener at localhost/46353] util.CommonFSUtils(682): File system contents for path hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5 2023-02-12 06:03:16,104 DEBUG [Listener at localhost/46353] util.CommonFSUtils(699): |-data/ 2023-02-12 06:03:16,105 DEBUG [Listener at localhost/46353] util.CommonFSUtils(699): |----default/ 2023-02-12 06:03:16,105 DEBUG [Listener at localhost/46353] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-12 06:03:16,106 DEBUG [Listener at localhost/46353] util.CommonFSUtils(699): |----------133d67c01c34b4394253d055b1241449/ 2023-02-12 06:03:16,106 DEBUG [Listener at localhost/46353] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 06:03:16,106 DEBUG [Listener at localhost/46353] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 06:03:16,107 DEBUG [Listener at localhost/46353] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=133d67c01c34b4394253d055b1241449-c6eaf0a2e96540d09d8a3b25e52ac0a5 2023-02-12 06:03:16,107 DEBUG [Listener at localhost/46353] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 06:03:16,107 DEBUG [Listener at localhost/46353] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=133d67c01c34b4394253d055b1241449-24d7a82e17e14f00ae6634dfb4a31d0c 2023-02-12 06:03:16,107 DEBUG [Listener at localhost/46353] util.CommonFSUtils(699): |----------1427e4a55ff7e244357b88ef84871819/ 2023-02-12 06:03:16,107 DEBUG [Listener at localhost/46353] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 06:03:16,108 DEBUG [Listener at localhost/46353] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 06:03:16,108 DEBUG [Listener at localhost/46353] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=1427e4a55ff7e244357b88ef84871819-1959035159db463d8630aad23b311c80 2023-02-12 06:03:16,108 DEBUG [Listener at localhost/46353] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 06:03:16,108 DEBUG [Listener at localhost/46353] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=1427e4a55ff7e244357b88ef84871819-f777697bc6e84cc6a9aef92bd477a0eb 2023-02-12 06:03:16,108 DEBUG [Listener at localhost/46353] util.CommonFSUtils(699): |----------36c2a20d70c505da7da65238cdb01a2d/ 2023-02-12 06:03:16,109 DEBUG [Listener at localhost/46353] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 06:03:16,109 DEBUG [Listener at localhost/46353] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 06:03:16,109 DEBUG [Listener at localhost/46353] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=36c2a20d70c505da7da65238cdb01a2d-df193a96811949fea9c667f090d8daed 2023-02-12 06:03:16,109 DEBUG [Listener at localhost/46353] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 06:03:16,109 DEBUG [Listener at localhost/46353] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=36c2a20d70c505da7da65238cdb01a2d-8755b9d62b29447a88c673100ec1fe73 2023-02-12 06:03:16,109 DEBUG [Listener at localhost/46353] util.CommonFSUtils(699): |----------3f09441dd1b0444e613ff01a617719fc/ 2023-02-12 06:03:16,109 DEBUG [Listener at localhost/46353] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 06:03:16,109 DEBUG [Listener at localhost/46353] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 06:03:16,110 DEBUG [Listener at localhost/46353] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=3f09441dd1b0444e613ff01a617719fc-05a3907316834a66b9d2a4a881c4a24c 2023-02-12 06:03:16,110 DEBUG [Listener at localhost/46353] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 06:03:16,110 DEBUG [Listener at localhost/46353] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=3f09441dd1b0444e613ff01a617719fc-bbe96aa49e0a4b26ac1eaad6e50d9b95 2023-02-12 06:03:16,110 DEBUG [Listener at localhost/46353] util.CommonFSUtils(699): |----------530f05fe8dbd50117feed5e471b6c59e/ 2023-02-12 06:03:16,110 DEBUG [Listener at localhost/46353] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 06:03:16,110 DEBUG [Listener at localhost/46353] util.CommonFSUtils(699): |----------76756473478f2c8afca1ab066347a4a0/ 2023-02-12 06:03:16,111 DEBUG [Listener at localhost/46353] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 06:03:16,111 DEBUG [Listener at localhost/46353] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 06:03:16,111 DEBUG [Listener at localhost/46353] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=76756473478f2c8afca1ab066347a4a0-7e0d41db2f15422f99136a86786ad9c7 2023-02-12 06:03:16,111 DEBUG [Listener at localhost/46353] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 06:03:16,111 DEBUG [Listener at localhost/46353] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=76756473478f2c8afca1ab066347a4a0-737f282067b74816baf7532822744639 2023-02-12 06:03:16,111 DEBUG [Listener at localhost/46353] util.CommonFSUtils(699): |----------77a828f6a35d46d6316183425b87ba6d/ 2023-02-12 06:03:16,112 DEBUG [Listener at localhost/46353] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 06:03:16,112 DEBUG [Listener at localhost/46353] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 06:03:16,112 DEBUG [Listener at localhost/46353] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=77a828f6a35d46d6316183425b87ba6d-6a40b939d810444db0b9ae1c7bda56e7 2023-02-12 06:03:16,112 DEBUG [Listener at localhost/46353] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 06:03:16,112 DEBUG [Listener at localhost/46353] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=77a828f6a35d46d6316183425b87ba6d-7997c088a92b4745b8258b963575b023 2023-02-12 06:03:16,112 DEBUG [Listener at localhost/46353] util.CommonFSUtils(699): |----------85f78445f74da16716afdb76512ecb80/ 2023-02-12 06:03:16,113 DEBUG [Listener at localhost/46353] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 06:03:16,113 DEBUG [Listener at localhost/46353] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 06:03:16,113 DEBUG [Listener at localhost/46353] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=85f78445f74da16716afdb76512ecb80-b66b61dc87ab475bb9dd8b442d40b08b 2023-02-12 06:03:16,113 DEBUG [Listener at localhost/46353] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 06:03:16,113 DEBUG [Listener at localhost/46353] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=85f78445f74da16716afdb76512ecb80-85d74dd407604825ab015d4371bbda74 2023-02-12 06:03:16,113 DEBUG [Listener at localhost/46353] util.CommonFSUtils(699): |----------c7a9336f8bb0a79325c1dfbd145f634b/ 2023-02-12 06:03:16,113 DEBUG [Listener at localhost/46353] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 06:03:16,114 DEBUG [Listener at localhost/46353] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 06:03:16,114 DEBUG [Listener at localhost/46353] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=c7a9336f8bb0a79325c1dfbd145f634b-5ecd0027248444cda169180d9f1fa4fa 2023-02-12 06:03:16,114 DEBUG [Listener at localhost/46353] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 06:03:16,114 DEBUG [Listener at localhost/46353] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=c7a9336f8bb0a79325c1dfbd145f634b-6c20a7b29b8443c78c81ef9262cf1e09 2023-02-12 06:03:16,114 DEBUG [Listener at localhost/46353] util.CommonFSUtils(699): |----------c9e3aa687caae91031a86b0af14dbc7b/ 2023-02-12 06:03:16,114 DEBUG [Listener at localhost/46353] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 06:03:16,117 INFO [Listener at localhost/46353] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-12 06:03:16,801 DEBUG [Listener at localhost/46353] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676181792831.133d67c01c34b4394253d055b1241449.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:16,802 INFO [Listener at localhost/46353] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 06:03:16,803 DEBUG [Listener at localhost/46353] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:03:16,805 INFO [StoreOpener-133d67c01c34b4394253d055b1241449-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 133d67c01c34b4394253d055b1241449 2023-02-12 06:03:16,806 DEBUG [StoreOpener-133d67c01c34b4394253d055b1241449-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/f1 2023-02-12 06:03:16,807 INFO [StoreOpener-133d67c01c34b4394253d055b1241449-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 133d67c01c34b4394253d055b1241449 columnFamilyName f1 2023-02-12 06:03:16,811 DEBUG [StoreOpener-133d67c01c34b4394253d055b1241449-1] regionserver.HStore(539): loaded hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/f1/testWithMockedMapReduceMultiRegion=133d67c01c34b4394253d055b1241449-c6eaf0a2e96540d09d8a3b25e52ac0a5 2023-02-12 06:03:16,812 INFO [StoreOpener-133d67c01c34b4394253d055b1241449-1] regionserver.HStore(310): Store=133d67c01c34b4394253d055b1241449/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:16,812 INFO [StoreOpener-133d67c01c34b4394253d055b1241449-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 133d67c01c34b4394253d055b1241449 2023-02-12 06:03:16,813 DEBUG [StoreOpener-133d67c01c34b4394253d055b1241449-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/f2 2023-02-12 06:03:16,813 INFO [StoreOpener-133d67c01c34b4394253d055b1241449-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 133d67c01c34b4394253d055b1241449 columnFamilyName f2 2023-02-12 06:03:16,817 DEBUG [StoreOpener-133d67c01c34b4394253d055b1241449-1] regionserver.HStore(539): loaded hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/f2/testWithMockedMapReduceMultiRegion=133d67c01c34b4394253d055b1241449-24d7a82e17e14f00ae6634dfb4a31d0c 2023-02-12 06:03:16,817 INFO [StoreOpener-133d67c01c34b4394253d055b1241449-1] regionserver.HStore(310): Store=133d67c01c34b4394253d055b1241449/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:16,817 DEBUG [Listener at localhost/46353] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:03:16,817 INFO [Listener at localhost/46353] regionserver.HRegion(1071): Opened 133d67c01c34b4394253d055b1241449; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74317046, jitterRate=0.10741028189659119}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:03:16,817 DEBUG [Listener at localhost/46353] regionserver.HRegion(964): Region open journal for 133d67c01c34b4394253d055b1241449: Writing region info on filesystem at 1676181796803Initializing all the Stores at 1676181796804 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181796804Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181796804Region opened successfully at 1676181796817 (+13 ms) 2023-02-12 06:03:16,826 DEBUG [Listener at localhost/46353] regionserver.HRegion(1603): Closing 133d67c01c34b4394253d055b1241449, disabling compactions & flushes 2023-02-12 06:03:16,826 INFO [Listener at localhost/46353] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676181792831.133d67c01c34b4394253d055b1241449. 2023-02-12 06:03:16,826 DEBUG [Listener at localhost/46353] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676181792831.133d67c01c34b4394253d055b1241449. 2023-02-12 06:03:16,826 DEBUG [Listener at localhost/46353] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676181792831.133d67c01c34b4394253d055b1241449. after waiting 0 ms 2023-02-12 06:03:16,826 DEBUG [Listener at localhost/46353] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676181792831.133d67c01c34b4394253d055b1241449. 2023-02-12 06:03:16,827 INFO [Listener at localhost/46353] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676181792831.133d67c01c34b4394253d055b1241449. 2023-02-12 06:03:16,827 DEBUG [Listener at localhost/46353] regionserver.HRegion(1557): Region close journal for 133d67c01c34b4394253d055b1241449: Waiting for close lock at 1676181796826Disabling compacts and flushes for region at 1676181796826Disabling writes for close at 1676181796826Writing region close event to WAL at 1676181796827 (+1 ms)Closed at 1676181796827 2023-02-12 06:03:16,827 DEBUG [Listener at localhost/46353] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:16,827 INFO [Listener at localhost/46353] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 06:03:16,829 DEBUG [Listener at localhost/46353] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:03:16,830 INFO [StoreOpener-36c2a20d70c505da7da65238cdb01a2d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 36c2a20d70c505da7da65238cdb01a2d 2023-02-12 06:03:16,831 DEBUG [StoreOpener-36c2a20d70c505da7da65238cdb01a2d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/f1 2023-02-12 06:03:16,832 INFO [StoreOpener-36c2a20d70c505da7da65238cdb01a2d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 36c2a20d70c505da7da65238cdb01a2d columnFamilyName f1 2023-02-12 06:03:16,835 DEBUG [StoreOpener-36c2a20d70c505da7da65238cdb01a2d-1] regionserver.HStore(539): loaded hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/f1/testWithMockedMapReduceMultiRegion=36c2a20d70c505da7da65238cdb01a2d-df193a96811949fea9c667f090d8daed 2023-02-12 06:03:16,836 INFO [StoreOpener-36c2a20d70c505da7da65238cdb01a2d-1] regionserver.HStore(310): Store=36c2a20d70c505da7da65238cdb01a2d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:16,836 INFO [StoreOpener-36c2a20d70c505da7da65238cdb01a2d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 36c2a20d70c505da7da65238cdb01a2d 2023-02-12 06:03:16,836 DEBUG [StoreOpener-36c2a20d70c505da7da65238cdb01a2d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/f2 2023-02-12 06:03:16,837 INFO [StoreOpener-36c2a20d70c505da7da65238cdb01a2d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 36c2a20d70c505da7da65238cdb01a2d columnFamilyName f2 2023-02-12 06:03:16,841 DEBUG [StoreOpener-36c2a20d70c505da7da65238cdb01a2d-1] regionserver.HStore(539): loaded hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/f2/testWithMockedMapReduceMultiRegion=36c2a20d70c505da7da65238cdb01a2d-8755b9d62b29447a88c673100ec1fe73 2023-02-12 06:03:16,842 INFO [StoreOpener-36c2a20d70c505da7da65238cdb01a2d-1] regionserver.HStore(310): Store=36c2a20d70c505da7da65238cdb01a2d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:16,842 DEBUG [Listener at localhost/46353] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:03:16,842 INFO [Listener at localhost/46353] regionserver.HRegion(1071): Opened 36c2a20d70c505da7da65238cdb01a2d; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60174613, jitterRate=-0.1033283919095993}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:03:16,842 DEBUG [Listener at localhost/46353] regionserver.HRegion(964): Region open journal for 36c2a20d70c505da7da65238cdb01a2d: Writing region info on filesystem at 1676181796829Initializing all the Stores at 1676181796829Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181796829Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181796830 (+1 ms)Region opened successfully at 1676181796842 (+12 ms) 2023-02-12 06:03:16,850 DEBUG [Listener at localhost/46353] regionserver.HRegion(1603): Closing 36c2a20d70c505da7da65238cdb01a2d, disabling compactions & flushes 2023-02-12 06:03:16,852 INFO [Listener at localhost/46353] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d. 2023-02-12 06:03:16,852 DEBUG [Listener at localhost/46353] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d. 2023-02-12 06:03:16,852 DEBUG [Listener at localhost/46353] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d. after waiting 0 ms 2023-02-12 06:03:16,852 DEBUG [Listener at localhost/46353] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d. 2023-02-12 06:03:16,852 INFO [Listener at localhost/46353] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d. 2023-02-12 06:03:16,852 DEBUG [Listener at localhost/46353] regionserver.HRegion(1557): Region close journal for 36c2a20d70c505da7da65238cdb01a2d: Waiting for close lock at 1676181796850Disabling compacts and flushes for region at 1676181796850Disabling writes for close at 1676181796852 (+2 ms)Writing region close event to WAL at 1676181796852Closed at 1676181796852 2023-02-12 06:03:16,853 DEBUG [Listener at localhost/46353] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:16,853 INFO [Listener at localhost/46353] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 06:03:16,854 DEBUG [Listener at localhost/46353] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:03:16,856 INFO [StoreOpener-1427e4a55ff7e244357b88ef84871819-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 1427e4a55ff7e244357b88ef84871819 2023-02-12 06:03:16,857 DEBUG [StoreOpener-1427e4a55ff7e244357b88ef84871819-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/f1 2023-02-12 06:03:16,857 INFO [StoreOpener-1427e4a55ff7e244357b88ef84871819-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1427e4a55ff7e244357b88ef84871819 columnFamilyName f1 2023-02-12 06:03:16,863 DEBUG [StoreOpener-1427e4a55ff7e244357b88ef84871819-1] regionserver.HStore(539): loaded hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/f1/testWithMockedMapReduceMultiRegion=1427e4a55ff7e244357b88ef84871819-1959035159db463d8630aad23b311c80 2023-02-12 06:03:16,863 INFO [StoreOpener-1427e4a55ff7e244357b88ef84871819-1] regionserver.HStore(310): Store=1427e4a55ff7e244357b88ef84871819/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:16,863 INFO [StoreOpener-1427e4a55ff7e244357b88ef84871819-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 1427e4a55ff7e244357b88ef84871819 2023-02-12 06:03:16,864 DEBUG [StoreOpener-1427e4a55ff7e244357b88ef84871819-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/f2 2023-02-12 06:03:16,865 INFO [StoreOpener-1427e4a55ff7e244357b88ef84871819-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1427e4a55ff7e244357b88ef84871819 columnFamilyName f2 2023-02-12 06:03:16,869 DEBUG [StoreOpener-1427e4a55ff7e244357b88ef84871819-1] regionserver.HStore(539): loaded hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/f2/testWithMockedMapReduceMultiRegion=1427e4a55ff7e244357b88ef84871819-f777697bc6e84cc6a9aef92bd477a0eb 2023-02-12 06:03:16,869 INFO [StoreOpener-1427e4a55ff7e244357b88ef84871819-1] regionserver.HStore(310): Store=1427e4a55ff7e244357b88ef84871819/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:16,869 DEBUG [Listener at localhost/46353] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:03:16,869 INFO [Listener at localhost/46353] regionserver.HRegion(1071): Opened 1427e4a55ff7e244357b88ef84871819; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59549683, jitterRate=-0.11264057457447052}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:03:16,869 DEBUG [Listener at localhost/46353] regionserver.HRegion(964): Region open journal for 1427e4a55ff7e244357b88ef84871819: Writing region info on filesystem at 1676181796854Initializing all the Stores at 1676181796855 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181796855Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181796855Region opened successfully at 1676181796869 (+14 ms) 2023-02-12 06:03:16,879 DEBUG [Listener at localhost/46353] regionserver.HRegion(1603): Closing 1427e4a55ff7e244357b88ef84871819, disabling compactions & flushes 2023-02-12 06:03:16,879 INFO [Listener at localhost/46353] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819. 2023-02-12 06:03:16,879 DEBUG [Listener at localhost/46353] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819. 2023-02-12 06:03:16,879 DEBUG [Listener at localhost/46353] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819. after waiting 0 ms 2023-02-12 06:03:16,879 DEBUG [Listener at localhost/46353] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819. 2023-02-12 06:03:16,880 INFO [Listener at localhost/46353] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819. 2023-02-12 06:03:16,880 DEBUG [Listener at localhost/46353] regionserver.HRegion(1557): Region close journal for 1427e4a55ff7e244357b88ef84871819: Waiting for close lock at 1676181796879Disabling compacts and flushes for region at 1676181796879Disabling writes for close at 1676181796879Writing region close event to WAL at 1676181796880 (+1 ms)Closed at 1676181796880 2023-02-12 06:03:16,880 DEBUG [Listener at localhost/46353] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:16,880 INFO [Listener at localhost/46353] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 06:03:16,882 DEBUG [Listener at localhost/46353] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:03:16,884 INFO [StoreOpener-530f05fe8dbd50117feed5e471b6c59e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 530f05fe8dbd50117feed5e471b6c59e 2023-02-12 06:03:16,885 DEBUG [StoreOpener-530f05fe8dbd50117feed5e471b6c59e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5/data/default/testWithMockedMapReduceMultiRegion/530f05fe8dbd50117feed5e471b6c59e/f1 2023-02-12 06:03:16,885 INFO [StoreOpener-530f05fe8dbd50117feed5e471b6c59e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 530f05fe8dbd50117feed5e471b6c59e columnFamilyName f1 2023-02-12 06:03:16,886 INFO [StoreOpener-530f05fe8dbd50117feed5e471b6c59e-1] regionserver.HStore(310): Store=530f05fe8dbd50117feed5e471b6c59e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:16,886 INFO [StoreOpener-530f05fe8dbd50117feed5e471b6c59e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 530f05fe8dbd50117feed5e471b6c59e 2023-02-12 06:03:16,887 DEBUG [StoreOpener-530f05fe8dbd50117feed5e471b6c59e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5/data/default/testWithMockedMapReduceMultiRegion/530f05fe8dbd50117feed5e471b6c59e/f2 2023-02-12 06:03:16,887 INFO [StoreOpener-530f05fe8dbd50117feed5e471b6c59e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 530f05fe8dbd50117feed5e471b6c59e columnFamilyName f2 2023-02-12 06:03:16,887 INFO [StoreOpener-530f05fe8dbd50117feed5e471b6c59e-1] regionserver.HStore(310): Store=530f05fe8dbd50117feed5e471b6c59e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:16,888 DEBUG [Listener at localhost/46353] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:03:16,888 INFO [Listener at localhost/46353] regionserver.HRegion(1071): Opened 530f05fe8dbd50117feed5e471b6c59e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73832669, jitterRate=0.10019250214099884}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:03:16,888 DEBUG [Listener at localhost/46353] regionserver.HRegion(964): Region open journal for 530f05fe8dbd50117feed5e471b6c59e: Writing region info on filesystem at 1676181796882Initializing all the Stores at 1676181796883 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181796883Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181796883Region opened successfully at 1676181796888 (+5 ms) 2023-02-12 06:03:16,888 DEBUG [Listener at localhost/46353] regionserver.HRegion(1603): Closing 530f05fe8dbd50117feed5e471b6c59e, disabling compactions & flushes 2023-02-12 06:03:16,888 INFO [Listener at localhost/46353] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e. 2023-02-12 06:03:16,888 DEBUG [Listener at localhost/46353] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e. 2023-02-12 06:03:16,888 DEBUG [Listener at localhost/46353] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e. after waiting 0 ms 2023-02-12 06:03:16,888 DEBUG [Listener at localhost/46353] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e. 2023-02-12 06:03:16,888 INFO [Listener at localhost/46353] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e. 2023-02-12 06:03:16,888 DEBUG [Listener at localhost/46353] regionserver.HRegion(1557): Region close journal for 530f05fe8dbd50117feed5e471b6c59e: Waiting for close lock at 1676181796888Disabling compacts and flushes for region at 1676181796888Disabling writes for close at 1676181796888Writing region close event to WAL at 1676181796888Closed at 1676181796888 2023-02-12 06:03:16,889 DEBUG [Listener at localhost/46353] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:16,889 INFO [Listener at localhost/46353] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 06:03:16,890 DEBUG [Listener at localhost/46353] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:03:16,892 INFO [StoreOpener-3f09441dd1b0444e613ff01a617719fc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3f09441dd1b0444e613ff01a617719fc 2023-02-12 06:03:16,893 DEBUG [StoreOpener-3f09441dd1b0444e613ff01a617719fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/f1 2023-02-12 06:03:16,893 INFO [StoreOpener-3f09441dd1b0444e613ff01a617719fc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f09441dd1b0444e613ff01a617719fc columnFamilyName f1 2023-02-12 06:03:16,897 DEBUG [StoreOpener-3f09441dd1b0444e613ff01a617719fc-1] regionserver.HStore(539): loaded hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/f1/testWithMockedMapReduceMultiRegion=3f09441dd1b0444e613ff01a617719fc-05a3907316834a66b9d2a4a881c4a24c 2023-02-12 06:03:16,897 INFO [StoreOpener-3f09441dd1b0444e613ff01a617719fc-1] regionserver.HStore(310): Store=3f09441dd1b0444e613ff01a617719fc/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:16,897 INFO [StoreOpener-3f09441dd1b0444e613ff01a617719fc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3f09441dd1b0444e613ff01a617719fc 2023-02-12 06:03:16,897 DEBUG [StoreOpener-3f09441dd1b0444e613ff01a617719fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/f2 2023-02-12 06:03:16,898 INFO [StoreOpener-3f09441dd1b0444e613ff01a617719fc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f09441dd1b0444e613ff01a617719fc columnFamilyName f2 2023-02-12 06:03:16,901 DEBUG [StoreOpener-3f09441dd1b0444e613ff01a617719fc-1] regionserver.HStore(539): loaded hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/f2/testWithMockedMapReduceMultiRegion=3f09441dd1b0444e613ff01a617719fc-bbe96aa49e0a4b26ac1eaad6e50d9b95 2023-02-12 06:03:16,901 INFO [StoreOpener-3f09441dd1b0444e613ff01a617719fc-1] regionserver.HStore(310): Store=3f09441dd1b0444e613ff01a617719fc/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:16,902 DEBUG [Listener at localhost/46353] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:03:16,902 INFO [Listener at localhost/46353] regionserver.HRegion(1071): Opened 3f09441dd1b0444e613ff01a617719fc; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59466645, jitterRate=-0.11387793719768524}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:03:16,902 DEBUG [Listener at localhost/46353] regionserver.HRegion(964): Region open journal for 3f09441dd1b0444e613ff01a617719fc: Writing region info on filesystem at 1676181796890Initializing all the Stores at 1676181796891 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181796891Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181796891Region opened successfully at 1676181796902 (+11 ms) 2023-02-12 06:03:16,909 DEBUG [Listener at localhost/46353] regionserver.HRegion(1603): Closing 3f09441dd1b0444e613ff01a617719fc, disabling compactions & flushes 2023-02-12 06:03:16,909 INFO [Listener at localhost/46353] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc. 2023-02-12 06:03:16,909 DEBUG [Listener at localhost/46353] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc. 2023-02-12 06:03:16,910 DEBUG [Listener at localhost/46353] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc. after waiting 0 ms 2023-02-12 06:03:16,910 DEBUG [Listener at localhost/46353] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc. 2023-02-12 06:03:16,910 INFO [Listener at localhost/46353] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc. 2023-02-12 06:03:16,910 DEBUG [Listener at localhost/46353] regionserver.HRegion(1557): Region close journal for 3f09441dd1b0444e613ff01a617719fc: Waiting for close lock at 1676181796909Disabling compacts and flushes for region at 1676181796909Disabling writes for close at 1676181796910 (+1 ms)Writing region close event to WAL at 1676181796910Closed at 1676181796910 2023-02-12 06:03:16,911 DEBUG [Listener at localhost/46353] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:16,911 INFO [Listener at localhost/46353] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 06:03:16,915 DEBUG [Listener at localhost/46353] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:03:16,917 INFO [StoreOpener-76756473478f2c8afca1ab066347a4a0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 76756473478f2c8afca1ab066347a4a0 2023-02-12 06:03:16,917 DEBUG [StoreOpener-76756473478f2c8afca1ab066347a4a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/f1 2023-02-12 06:03:16,918 INFO [StoreOpener-76756473478f2c8afca1ab066347a4a0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 76756473478f2c8afca1ab066347a4a0 columnFamilyName f1 2023-02-12 06:03:16,923 DEBUG [StoreOpener-76756473478f2c8afca1ab066347a4a0-1] regionserver.HStore(539): loaded hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/f1/testWithMockedMapReduceMultiRegion=76756473478f2c8afca1ab066347a4a0-7e0d41db2f15422f99136a86786ad9c7 2023-02-12 06:03:16,923 INFO [StoreOpener-76756473478f2c8afca1ab066347a4a0-1] regionserver.HStore(310): Store=76756473478f2c8afca1ab066347a4a0/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:16,924 INFO [StoreOpener-76756473478f2c8afca1ab066347a4a0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 76756473478f2c8afca1ab066347a4a0 2023-02-12 06:03:16,924 DEBUG [StoreOpener-76756473478f2c8afca1ab066347a4a0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/f2 2023-02-12 06:03:16,925 INFO [StoreOpener-76756473478f2c8afca1ab066347a4a0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 76756473478f2c8afca1ab066347a4a0 columnFamilyName f2 2023-02-12 06:03:16,929 DEBUG [StoreOpener-76756473478f2c8afca1ab066347a4a0-1] regionserver.HStore(539): loaded hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/f2/testWithMockedMapReduceMultiRegion=76756473478f2c8afca1ab066347a4a0-737f282067b74816baf7532822744639 2023-02-12 06:03:16,929 INFO [StoreOpener-76756473478f2c8afca1ab066347a4a0-1] regionserver.HStore(310): Store=76756473478f2c8afca1ab066347a4a0/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:16,929 DEBUG [Listener at localhost/46353] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:03:16,929 INFO [Listener at localhost/46353] regionserver.HRegion(1071): Opened 76756473478f2c8afca1ab066347a4a0; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61609818, jitterRate=-0.08194217085838318}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:03:16,929 DEBUG [Listener at localhost/46353] regionserver.HRegion(964): Region open journal for 76756473478f2c8afca1ab066347a4a0: Writing region info on filesystem at 1676181796915Initializing all the Stores at 1676181796915Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181796915Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181796915Region opened successfully at 1676181796929 (+14 ms) 2023-02-12 06:03:16,938 DEBUG [Listener at localhost/46353] regionserver.HRegion(1603): Closing 76756473478f2c8afca1ab066347a4a0, disabling compactions & flushes 2023-02-12 06:03:16,938 INFO [Listener at localhost/46353] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0. 2023-02-12 06:03:16,938 DEBUG [Listener at localhost/46353] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0. 2023-02-12 06:03:16,938 DEBUG [Listener at localhost/46353] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0. after waiting 0 ms 2023-02-12 06:03:16,938 DEBUG [Listener at localhost/46353] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0. 2023-02-12 06:03:16,939 INFO [Listener at localhost/46353] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0. 2023-02-12 06:03:16,939 DEBUG [Listener at localhost/46353] regionserver.HRegion(1557): Region close journal for 76756473478f2c8afca1ab066347a4a0: Waiting for close lock at 1676181796938Disabling compacts and flushes for region at 1676181796938Disabling writes for close at 1676181796938Writing region close event to WAL at 1676181796939 (+1 ms)Closed at 1676181796939 2023-02-12 06:03:16,939 DEBUG [Listener at localhost/46353] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:16,940 INFO [Listener at localhost/46353] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 06:03:16,943 DEBUG [Listener at localhost/46353] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:03:16,944 INFO [StoreOpener-77a828f6a35d46d6316183425b87ba6d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 77a828f6a35d46d6316183425b87ba6d 2023-02-12 06:03:16,945 DEBUG [StoreOpener-77a828f6a35d46d6316183425b87ba6d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/f1 2023-02-12 06:03:16,946 INFO [StoreOpener-77a828f6a35d46d6316183425b87ba6d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 77a828f6a35d46d6316183425b87ba6d columnFamilyName f1 2023-02-12 06:03:16,950 DEBUG [StoreOpener-77a828f6a35d46d6316183425b87ba6d-1] regionserver.HStore(539): loaded hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/f1/testWithMockedMapReduceMultiRegion=77a828f6a35d46d6316183425b87ba6d-6a40b939d810444db0b9ae1c7bda56e7 2023-02-12 06:03:16,950 INFO [StoreOpener-77a828f6a35d46d6316183425b87ba6d-1] regionserver.HStore(310): Store=77a828f6a35d46d6316183425b87ba6d/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:16,950 INFO [StoreOpener-77a828f6a35d46d6316183425b87ba6d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 77a828f6a35d46d6316183425b87ba6d 2023-02-12 06:03:16,951 DEBUG [StoreOpener-77a828f6a35d46d6316183425b87ba6d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/f2 2023-02-12 06:03:16,951 INFO [StoreOpener-77a828f6a35d46d6316183425b87ba6d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 77a828f6a35d46d6316183425b87ba6d columnFamilyName f2 2023-02-12 06:03:16,956 DEBUG [StoreOpener-77a828f6a35d46d6316183425b87ba6d-1] regionserver.HStore(539): loaded hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/f2/testWithMockedMapReduceMultiRegion=77a828f6a35d46d6316183425b87ba6d-7997c088a92b4745b8258b963575b023 2023-02-12 06:03:16,956 INFO [StoreOpener-77a828f6a35d46d6316183425b87ba6d-1] regionserver.HStore(310): Store=77a828f6a35d46d6316183425b87ba6d/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:16,956 DEBUG [Listener at localhost/46353] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:03:16,957 INFO [Listener at localhost/46353] regionserver.HRegion(1071): Opened 77a828f6a35d46d6316183425b87ba6d; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73384847, jitterRate=0.0935194343328476}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:03:16,957 DEBUG [Listener at localhost/46353] regionserver.HRegion(964): Region open journal for 77a828f6a35d46d6316183425b87ba6d: Writing region info on filesystem at 1676181796943Initializing all the Stores at 1676181796943Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181796943Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181796943Region opened successfully at 1676181796957 (+14 ms) 2023-02-12 06:03:16,965 DEBUG [Listener at localhost/46353] regionserver.HRegion(1603): Closing 77a828f6a35d46d6316183425b87ba6d, disabling compactions & flushes 2023-02-12 06:03:16,966 INFO [Listener at localhost/46353] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d. 2023-02-12 06:03:16,966 DEBUG [Listener at localhost/46353] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d. 2023-02-12 06:03:16,966 DEBUG [Listener at localhost/46353] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d. after waiting 0 ms 2023-02-12 06:03:16,966 DEBUG [Listener at localhost/46353] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d. 2023-02-12 06:03:16,967 INFO [Listener at localhost/46353] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d. 2023-02-12 06:03:16,967 DEBUG [Listener at localhost/46353] regionserver.HRegion(1557): Region close journal for 77a828f6a35d46d6316183425b87ba6d: Waiting for close lock at 1676181796965Disabling compacts and flushes for region at 1676181796965Disabling writes for close at 1676181796966 (+1 ms)Writing region close event to WAL at 1676181796967 (+1 ms)Closed at 1676181796967 2023-02-12 06:03:16,968 DEBUG [Listener at localhost/46353] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:16,968 INFO [Listener at localhost/46353] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 06:03:16,969 DEBUG [Listener at localhost/46353] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:03:16,971 INFO [StoreOpener-c9e3aa687caae91031a86b0af14dbc7b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c9e3aa687caae91031a86b0af14dbc7b 2023-02-12 06:03:16,973 DEBUG [StoreOpener-c9e3aa687caae91031a86b0af14dbc7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5/data/default/testWithMockedMapReduceMultiRegion/c9e3aa687caae91031a86b0af14dbc7b/f1 2023-02-12 06:03:16,973 INFO [StoreOpener-c9e3aa687caae91031a86b0af14dbc7b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c9e3aa687caae91031a86b0af14dbc7b columnFamilyName f1 2023-02-12 06:03:16,973 INFO [StoreOpener-c9e3aa687caae91031a86b0af14dbc7b-1] regionserver.HStore(310): Store=c9e3aa687caae91031a86b0af14dbc7b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:16,973 INFO [StoreOpener-c9e3aa687caae91031a86b0af14dbc7b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c9e3aa687caae91031a86b0af14dbc7b 2023-02-12 06:03:16,974 DEBUG [StoreOpener-c9e3aa687caae91031a86b0af14dbc7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5/data/default/testWithMockedMapReduceMultiRegion/c9e3aa687caae91031a86b0af14dbc7b/f2 2023-02-12 06:03:16,975 INFO [StoreOpener-c9e3aa687caae91031a86b0af14dbc7b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c9e3aa687caae91031a86b0af14dbc7b columnFamilyName f2 2023-02-12 06:03:16,975 INFO [StoreOpener-c9e3aa687caae91031a86b0af14dbc7b-1] regionserver.HStore(310): Store=c9e3aa687caae91031a86b0af14dbc7b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:16,975 DEBUG [Listener at localhost/46353] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:03:16,975 INFO [Listener at localhost/46353] regionserver.HRegion(1071): Opened c9e3aa687caae91031a86b0af14dbc7b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58742756, jitterRate=-0.12466472387313843}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:03:16,975 DEBUG [Listener at localhost/46353] regionserver.HRegion(964): Region open journal for c9e3aa687caae91031a86b0af14dbc7b: Writing region info on filesystem at 1676181796969Initializing all the Stores at 1676181796969Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181796970 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181796971 (+1 ms)Region opened successfully at 1676181796975 (+4 ms) 2023-02-12 06:03:16,976 DEBUG [Listener at localhost/46353] regionserver.HRegion(1603): Closing c9e3aa687caae91031a86b0af14dbc7b, disabling compactions & flushes 2023-02-12 06:03:16,976 INFO [Listener at localhost/46353] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b. 2023-02-12 06:03:16,976 DEBUG [Listener at localhost/46353] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b. 2023-02-12 06:03:16,976 DEBUG [Listener at localhost/46353] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b. after waiting 0 ms 2023-02-12 06:03:16,976 DEBUG [Listener at localhost/46353] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b. 2023-02-12 06:03:16,977 INFO [Listener at localhost/46353] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b. 2023-02-12 06:03:16,977 DEBUG [Listener at localhost/46353] regionserver.HRegion(1557): Region close journal for c9e3aa687caae91031a86b0af14dbc7b: Waiting for close lock at 1676181796976Disabling compacts and flushes for region at 1676181796976Disabling writes for close at 1676181796976Writing region close event to WAL at 1676181796977 (+1 ms)Closed at 1676181796977 2023-02-12 06:03:16,977 DEBUG [Listener at localhost/46353] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:16,977 INFO [Listener at localhost/46353] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 06:03:16,979 DEBUG [Listener at localhost/46353] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:03:16,980 INFO [StoreOpener-85f78445f74da16716afdb76512ecb80-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 85f78445f74da16716afdb76512ecb80 2023-02-12 06:03:16,981 DEBUG [StoreOpener-85f78445f74da16716afdb76512ecb80-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/f1 2023-02-12 06:03:16,981 INFO [StoreOpener-85f78445f74da16716afdb76512ecb80-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 85f78445f74da16716afdb76512ecb80 columnFamilyName f1 2023-02-12 06:03:16,986 DEBUG [StoreOpener-85f78445f74da16716afdb76512ecb80-1] regionserver.HStore(539): loaded hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/f1/testWithMockedMapReduceMultiRegion=85f78445f74da16716afdb76512ecb80-b66b61dc87ab475bb9dd8b442d40b08b 2023-02-12 06:03:16,986 INFO [StoreOpener-85f78445f74da16716afdb76512ecb80-1] regionserver.HStore(310): Store=85f78445f74da16716afdb76512ecb80/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:16,986 INFO [StoreOpener-85f78445f74da16716afdb76512ecb80-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 85f78445f74da16716afdb76512ecb80 2023-02-12 06:03:16,987 DEBUG [StoreOpener-85f78445f74da16716afdb76512ecb80-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/f2 2023-02-12 06:03:16,987 INFO [StoreOpener-85f78445f74da16716afdb76512ecb80-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 85f78445f74da16716afdb76512ecb80 columnFamilyName f2 2023-02-12 06:03:16,990 DEBUG [StoreOpener-85f78445f74da16716afdb76512ecb80-1] regionserver.HStore(539): loaded hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/f2/testWithMockedMapReduceMultiRegion=85f78445f74da16716afdb76512ecb80-85d74dd407604825ab015d4371bbda74 2023-02-12 06:03:16,990 INFO [StoreOpener-85f78445f74da16716afdb76512ecb80-1] regionserver.HStore(310): Store=85f78445f74da16716afdb76512ecb80/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:16,991 DEBUG [Listener at localhost/46353] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:03:16,991 INFO [Listener at localhost/46353] regionserver.HRegion(1071): Opened 85f78445f74da16716afdb76512ecb80; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65551152, jitterRate=-0.02321171760559082}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:03:16,991 DEBUG [Listener at localhost/46353] regionserver.HRegion(964): Region open journal for 85f78445f74da16716afdb76512ecb80: Writing region info on filesystem at 1676181796979Initializing all the Stores at 1676181796979Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181796979Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181796979Region opened successfully at 1676181796991 (+12 ms) 2023-02-12 06:03:16,999 DEBUG [Listener at localhost/46353] regionserver.HRegion(1603): Closing 85f78445f74da16716afdb76512ecb80, disabling compactions & flushes 2023-02-12 06:03:16,999 INFO [Listener at localhost/46353] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80. 2023-02-12 06:03:16,999 DEBUG [Listener at localhost/46353] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80. 2023-02-12 06:03:16,999 DEBUG [Listener at localhost/46353] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80. after waiting 0 ms 2023-02-12 06:03:16,999 DEBUG [Listener at localhost/46353] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80. 2023-02-12 06:03:17,000 INFO [Listener at localhost/46353] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80. 2023-02-12 06:03:17,000 DEBUG [Listener at localhost/46353] regionserver.HRegion(1557): Region close journal for 85f78445f74da16716afdb76512ecb80: Waiting for close lock at 1676181796999Disabling compacts and flushes for region at 1676181796999Disabling writes for close at 1676181796999Writing region close event to WAL at 1676181797000 (+1 ms)Closed at 1676181797000 2023-02-12 06:03:17,000 DEBUG [Listener at localhost/46353] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:17,001 INFO [Listener at localhost/46353] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 06:03:17,002 DEBUG [Listener at localhost/46353] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:03:17,004 INFO [StoreOpener-c7a9336f8bb0a79325c1dfbd145f634b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c7a9336f8bb0a79325c1dfbd145f634b 2023-02-12 06:03:17,004 DEBUG [StoreOpener-c7a9336f8bb0a79325c1dfbd145f634b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/f1 2023-02-12 06:03:17,005 INFO [StoreOpener-c7a9336f8bb0a79325c1dfbd145f634b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7a9336f8bb0a79325c1dfbd145f634b columnFamilyName f1 2023-02-12 06:03:17,008 DEBUG [StoreOpener-c7a9336f8bb0a79325c1dfbd145f634b-1] regionserver.HStore(539): loaded hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/f1/testWithMockedMapReduceMultiRegion=c7a9336f8bb0a79325c1dfbd145f634b-5ecd0027248444cda169180d9f1fa4fa 2023-02-12 06:03:17,008 INFO [StoreOpener-c7a9336f8bb0a79325c1dfbd145f634b-1] regionserver.HStore(310): Store=c7a9336f8bb0a79325c1dfbd145f634b/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:17,008 INFO [StoreOpener-c7a9336f8bb0a79325c1dfbd145f634b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region c7a9336f8bb0a79325c1dfbd145f634b 2023-02-12 06:03:17,009 DEBUG [StoreOpener-c7a9336f8bb0a79325c1dfbd145f634b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/f2 2023-02-12 06:03:17,009 INFO [StoreOpener-c7a9336f8bb0a79325c1dfbd145f634b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c7a9336f8bb0a79325c1dfbd145f634b columnFamilyName f2 2023-02-12 06:03:17,013 DEBUG [StoreOpener-c7a9336f8bb0a79325c1dfbd145f634b-1] regionserver.HStore(539): loaded hdfs://localhost:45441/user/jenkins/test-data/07884705-a19e-167d-ef54-ca3d5e32fa84/testWithMockedMapReduceMultiRegion/c6f02a6e-53de-49fc-83c7-6442918caee5/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/f2/testWithMockedMapReduceMultiRegion=c7a9336f8bb0a79325c1dfbd145f634b-6c20a7b29b8443c78c81ef9262cf1e09 2023-02-12 06:03:17,013 INFO [StoreOpener-c7a9336f8bb0a79325c1dfbd145f634b-1] regionserver.HStore(310): Store=c7a9336f8bb0a79325c1dfbd145f634b/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:17,013 DEBUG [Listener at localhost/46353] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:03:17,013 INFO [Listener at localhost/46353] regionserver.HRegion(1071): Opened c7a9336f8bb0a79325c1dfbd145f634b; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61307996, jitterRate=-0.08643966913223267}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:03:17,013 DEBUG [Listener at localhost/46353] regionserver.HRegion(964): Region open journal for c7a9336f8bb0a79325c1dfbd145f634b: Writing region info on filesystem at 1676181797002Initializing all the Stores at 1676181797003 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181797003Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181797003Region opened successfully at 1676181797013 (+10 ms) 2023-02-12 06:03:17,023 DEBUG [Listener at localhost/46353] regionserver.HRegion(1603): Closing c7a9336f8bb0a79325c1dfbd145f634b, disabling compactions & flushes 2023-02-12 06:03:17,023 INFO [Listener at localhost/46353] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b. 2023-02-12 06:03:17,023 DEBUG [Listener at localhost/46353] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b. 2023-02-12 06:03:17,023 DEBUG [Listener at localhost/46353] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b. after waiting 0 ms 2023-02-12 06:03:17,023 DEBUG [Listener at localhost/46353] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b. 2023-02-12 06:03:17,024 INFO [Listener at localhost/46353] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b. 2023-02-12 06:03:17,024 DEBUG [Listener at localhost/46353] regionserver.HRegion(1557): Region close journal for c7a9336f8bb0a79325c1dfbd145f634b: Waiting for close lock at 1676181797023Disabling compacts and flushes for region at 1676181797023Disabling writes for close at 1676181797023Writing region close event to WAL at 1676181797024 (+1 ms)Closed at 1676181797024 2023-02-12 06:03:17,029 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-12 06:03:17,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-12 06:03:17,031 INFO [Listener at localhost/46353] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-12 06:03:17,032 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-12 06:03:17,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:17,035 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676181797035"}]},"ts":"1676181797035"} 2023-02-12 06:03:17,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-12 06:03:17,036 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-12 06:03:17,133 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-12 06:03:17,134 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c9e3aa687caae91031a86b0af14dbc7b, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c7a9336f8bb0a79325c1dfbd145f634b, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=85f78445f74da16716afdb76512ecb80, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=76756473478f2c8afca1ab066347a4a0, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=36c2a20d70c505da7da65238cdb01a2d, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=133d67c01c34b4394253d055b1241449, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=77a828f6a35d46d6316183425b87ba6d, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3f09441dd1b0444e613ff01a617719fc, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1427e4a55ff7e244357b88ef84871819, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=530f05fe8dbd50117feed5e471b6c59e, UNASSIGN}] 2023-02-12 06:03:17,137 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c7a9336f8bb0a79325c1dfbd145f634b, UNASSIGN 2023-02-12 06:03:17,137 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=85f78445f74da16716afdb76512ecb80, UNASSIGN 2023-02-12 06:03:17,137 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=76756473478f2c8afca1ab066347a4a0, UNASSIGN 2023-02-12 06:03:17,137 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=36c2a20d70c505da7da65238cdb01a2d, UNASSIGN 2023-02-12 06:03:17,137 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=530f05fe8dbd50117feed5e471b6c59e, UNASSIGN 2023-02-12 06:03:17,137 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=c7a9336f8bb0a79325c1dfbd145f634b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:17,137 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=85f78445f74da16716afdb76512ecb80, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:17,138 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=36c2a20d70c505da7da65238cdb01a2d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:17,138 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676181792831.85f78445f74da16716afdb76512ecb80.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676181797137"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181797137"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181797137"}]},"ts":"1676181797137"} 2023-02-12 06:03:17,138 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676181797137"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181797137"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181797137"}]},"ts":"1676181797137"} 2023-02-12 06:03:17,138 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=76756473478f2c8afca1ab066347a4a0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:17,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-12 06:03:17,138 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676181797138"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181797138"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181797138"}]},"ts":"1676181797138"} 2023-02-12 06:03:17,138 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676181797138"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181797138"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181797138"}]},"ts":"1676181797138"} 2023-02-12 06:03:17,138 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=530f05fe8dbd50117feed5e471b6c59e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:17,138 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676181797138"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181797138"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181797138"}]},"ts":"1676181797138"} 2023-02-12 06:03:17,139 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=36, state=RUNNABLE; CloseRegionProcedure 85f78445f74da16716afdb76512ecb80, server=jenkins-hbase4.apache.org,41035,1676181791508}] 2023-02-12 06:03:17,140 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=35, state=RUNNABLE; CloseRegionProcedure c7a9336f8bb0a79325c1dfbd145f634b, server=jenkins-hbase4.apache.org,33593,1676181791587}] 2023-02-12 06:03:17,140 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=37, state=RUNNABLE; CloseRegionProcedure 76756473478f2c8afca1ab066347a4a0, server=jenkins-hbase4.apache.org,41035,1676181791508}] 2023-02-12 06:03:17,141 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=38, state=RUNNABLE; CloseRegionProcedure 36c2a20d70c505da7da65238cdb01a2d, server=jenkins-hbase4.apache.org,33593,1676181791587}] 2023-02-12 06:03:17,142 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1427e4a55ff7e244357b88ef84871819, UNASSIGN 2023-02-12 06:03:17,142 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=43, state=RUNNABLE; CloseRegionProcedure 530f05fe8dbd50117feed5e471b6c59e, server=jenkins-hbase4.apache.org,33593,1676181791587}] 2023-02-12 06:03:17,142 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=1427e4a55ff7e244357b88ef84871819, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:17,142 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676181797142"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181797142"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181797142"}]},"ts":"1676181797142"} 2023-02-12 06:03:17,143 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3f09441dd1b0444e613ff01a617719fc, UNASSIGN 2023-02-12 06:03:17,143 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=77a828f6a35d46d6316183425b87ba6d, UNASSIGN 2023-02-12 06:03:17,144 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=3f09441dd1b0444e613ff01a617719fc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:17,144 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676181797143"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181797143"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181797143"}]},"ts":"1676181797143"} 2023-02-12 06:03:17,144 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure 1427e4a55ff7e244357b88ef84871819, server=jenkins-hbase4.apache.org,41035,1676181791508}] 2023-02-12 06:03:17,144 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=77a828f6a35d46d6316183425b87ba6d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:17,144 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=133d67c01c34b4394253d055b1241449, UNASSIGN 2023-02-12 06:03:17,144 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676181797144"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181797144"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181797144"}]},"ts":"1676181797144"} 2023-02-12 06:03:17,145 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=41, state=RUNNABLE; CloseRegionProcedure 3f09441dd1b0444e613ff01a617719fc, server=jenkins-hbase4.apache.org,33593,1676181791587}] 2023-02-12 06:03:17,145 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c9e3aa687caae91031a86b0af14dbc7b, UNASSIGN 2023-02-12 06:03:17,145 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=133d67c01c34b4394253d055b1241449, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:17,145 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676181792831.133d67c01c34b4394253d055b1241449.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676181797145"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181797145"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181797145"}]},"ts":"1676181797145"} 2023-02-12 06:03:17,146 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=c9e3aa687caae91031a86b0af14dbc7b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:17,146 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676181797146"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181797146"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181797146"}]},"ts":"1676181797146"} 2023-02-12 06:03:17,146 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=40, state=RUNNABLE; CloseRegionProcedure 77a828f6a35d46d6316183425b87ba6d, server=jenkins-hbase4.apache.org,41035,1676181791508}] 2023-02-12 06:03:17,150 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=39, state=RUNNABLE; CloseRegionProcedure 133d67c01c34b4394253d055b1241449, server=jenkins-hbase4.apache.org,33593,1676181791587}] 2023-02-12 06:03:17,151 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=34, state=RUNNABLE; CloseRegionProcedure c9e3aa687caae91031a86b0af14dbc7b, server=jenkins-hbase4.apache.org,41035,1676181791508}] 2023-02-12 06:03:17,292 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 85f78445f74da16716afdb76512ecb80 2023-02-12 06:03:17,292 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 3f09441dd1b0444e613ff01a617719fc 2023-02-12 06:03:17,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 85f78445f74da16716afdb76512ecb80, disabling compactions & flushes 2023-02-12 06:03:17,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3f09441dd1b0444e613ff01a617719fc, disabling compactions & flushes 2023-02-12 06:03:17,292 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80. 2023-02-12 06:03:17,292 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc. 2023-02-12 06:03:17,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80. 2023-02-12 06:03:17,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc. 2023-02-12 06:03:17,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80. after waiting 0 ms 2023-02-12 06:03:17,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80. 2023-02-12 06:03:17,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc. after waiting 0 ms 2023-02-12 06:03:17,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc. 2023-02-12 06:03:17,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 06:03:17,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 06:03:17,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc. 2023-02-12 06:03:17,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3f09441dd1b0444e613ff01a617719fc: Waiting for close lock at 1676181797292Running coprocessor pre-close hooks at 1676181797292Disabling compacts and flushes for region at 1676181797292Disabling writes for close at 1676181797292Writing region close event to WAL at 1676181797293 (+1 ms)Running coprocessor post-close hooks at 1676181797296 (+3 ms)Closed at 1676181797296 2023-02-12 06:03:17,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80. 2023-02-12 06:03:17,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 85f78445f74da16716afdb76512ecb80: Waiting for close lock at 1676181797292Running coprocessor pre-close hooks at 1676181797292Disabling compacts and flushes for region at 1676181797292Disabling writes for close at 1676181797292Writing region close event to WAL at 1676181797293 (+1 ms)Running coprocessor post-close hooks at 1676181797296 (+3 ms)Closed at 1676181797296 2023-02-12 06:03:17,298 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 3f09441dd1b0444e613ff01a617719fc 2023-02-12 06:03:17,298 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close c7a9336f8bb0a79325c1dfbd145f634b 2023-02-12 06:03:17,298 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c7a9336f8bb0a79325c1dfbd145f634b, disabling compactions & flushes 2023-02-12 06:03:17,298 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b. 2023-02-12 06:03:17,298 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b. 2023-02-12 06:03:17,298 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=3f09441dd1b0444e613ff01a617719fc, regionState=CLOSED 2023-02-12 06:03:17,298 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676181797298"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181797298"}]},"ts":"1676181797298"} 2023-02-12 06:03:17,298 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 85f78445f74da16716afdb76512ecb80 2023-02-12 06:03:17,298 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 1427e4a55ff7e244357b88ef84871819 2023-02-12 06:03:17,298 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1427e4a55ff7e244357b88ef84871819, disabling compactions & flushes 2023-02-12 06:03:17,298 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819. 2023-02-12 06:03:17,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819. 2023-02-12 06:03:17,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819. after waiting 0 ms 2023-02-12 06:03:17,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819. 2023-02-12 06:03:17,299 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=85f78445f74da16716afdb76512ecb80, regionState=CLOSED 2023-02-12 06:03:17,299 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676181792831.85f78445f74da16716afdb76512ecb80.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676181797299"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181797299"}]},"ts":"1676181797299"} 2023-02-12 06:03:17,298 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b. after waiting 0 ms 2023-02-12 06:03:17,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b. 2023-02-12 06:03:17,302 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=41 2023-02-12 06:03:17,303 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=41, state=SUCCESS; CloseRegionProcedure 3f09441dd1b0444e613ff01a617719fc, server=jenkins-hbase4.apache.org,33593,1676181791587 in 155 msec 2023-02-12 06:03:17,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 06:03:17,303 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819. 2023-02-12 06:03:17,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1427e4a55ff7e244357b88ef84871819: Waiting for close lock at 1676181797298Running coprocessor pre-close hooks at 1676181797298Disabling compacts and flushes for region at 1676181797298Disabling writes for close at 1676181797299 (+1 ms)Writing region close event to WAL at 1676181797299Running coprocessor post-close hooks at 1676181797303 (+4 ms)Closed at 1676181797303 2023-02-12 06:03:17,304 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=36 2023-02-12 06:03:17,304 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3f09441dd1b0444e613ff01a617719fc, UNASSIGN in 169 msec 2023-02-12 06:03:17,304 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=36, state=SUCCESS; CloseRegionProcedure 85f78445f74da16716afdb76512ecb80, server=jenkins-hbase4.apache.org,41035,1676181791508 in 163 msec 2023-02-12 06:03:17,305 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 1427e4a55ff7e244357b88ef84871819 2023-02-12 06:03:17,305 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 76756473478f2c8afca1ab066347a4a0 2023-02-12 06:03:17,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 76756473478f2c8afca1ab066347a4a0, disabling compactions & flushes 2023-02-12 06:03:17,305 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=85f78445f74da16716afdb76512ecb80, UNASSIGN in 170 msec 2023-02-12 06:03:17,305 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0. 2023-02-12 06:03:17,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0. 2023-02-12 06:03:17,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0. after waiting 0 ms 2023-02-12 06:03:17,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0. 2023-02-12 06:03:17,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 06:03:17,306 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=1427e4a55ff7e244357b88ef84871819, regionState=CLOSED 2023-02-12 06:03:17,306 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676181797306"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181797306"}]},"ts":"1676181797306"} 2023-02-12 06:03:17,306 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b. 2023-02-12 06:03:17,306 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c7a9336f8bb0a79325c1dfbd145f634b: Waiting for close lock at 1676181797298Running coprocessor pre-close hooks at 1676181797298Disabling compacts and flushes for region at 1676181797298Disabling writes for close at 1676181797300 (+2 ms)Writing region close event to WAL at 1676181797302 (+2 ms)Running coprocessor post-close hooks at 1676181797306 (+4 ms)Closed at 1676181797306 2023-02-12 06:03:17,307 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed c7a9336f8bb0a79325c1dfbd145f634b 2023-02-12 06:03:17,307 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 530f05fe8dbd50117feed5e471b6c59e 2023-02-12 06:03:17,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 530f05fe8dbd50117feed5e471b6c59e, disabling compactions & flushes 2023-02-12 06:03:17,307 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e. 2023-02-12 06:03:17,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e. 2023-02-12 06:03:17,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e. after waiting 0 ms 2023-02-12 06:03:17,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e. 2023-02-12 06:03:17,308 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=c7a9336f8bb0a79325c1dfbd145f634b, regionState=CLOSED 2023-02-12 06:03:17,308 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676181797308"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181797308"}]},"ts":"1676181797308"} 2023-02-12 06:03:17,309 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-12 06:03:17,309 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure 1427e4a55ff7e244357b88ef84871819, server=jenkins-hbase4.apache.org,41035,1676181791508 in 163 msec 2023-02-12 06:03:17,310 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=1427e4a55ff7e244357b88ef84871819, UNASSIGN in 175 msec 2023-02-12 06:03:17,312 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=35 2023-02-12 06:03:17,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/530f05fe8dbd50117feed5e471b6c59e/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-12 06:03:17,312 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=35, state=SUCCESS; CloseRegionProcedure c7a9336f8bb0a79325c1dfbd145f634b, server=jenkins-hbase4.apache.org,33593,1676181791587 in 170 msec 2023-02-12 06:03:17,312 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e. 2023-02-12 06:03:17,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 530f05fe8dbd50117feed5e471b6c59e: Waiting for close lock at 1676181797307Running coprocessor pre-close hooks at 1676181797307Disabling compacts and flushes for region at 1676181797307Disabling writes for close at 1676181797307Writing region close event to WAL at 1676181797308 (+1 ms)Running coprocessor post-close hooks at 1676181797312 (+4 ms)Closed at 1676181797312 2023-02-12 06:03:17,313 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c7a9336f8bb0a79325c1dfbd145f634b, UNASSIGN in 178 msec 2023-02-12 06:03:17,313 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 06:03:17,314 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0. 2023-02-12 06:03:17,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 76756473478f2c8afca1ab066347a4a0: Waiting for close lock at 1676181797305Running coprocessor pre-close hooks at 1676181797305Disabling compacts and flushes for region at 1676181797305Disabling writes for close at 1676181797305Writing region close event to WAL at 1676181797310 (+5 ms)Running coprocessor post-close hooks at 1676181797314 (+4 ms)Closed at 1676181797314 2023-02-12 06:03:17,314 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 530f05fe8dbd50117feed5e471b6c59e 2023-02-12 06:03:17,314 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 36c2a20d70c505da7da65238cdb01a2d 2023-02-12 06:03:17,314 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=530f05fe8dbd50117feed5e471b6c59e, regionState=CLOSED 2023-02-12 06:03:17,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 36c2a20d70c505da7da65238cdb01a2d, disabling compactions & flushes 2023-02-12 06:03:17,314 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d. 2023-02-12 06:03:17,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d. 2023-02-12 06:03:17,314 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676181797314"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181797314"}]},"ts":"1676181797314"} 2023-02-12 06:03:17,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d. after waiting 0 ms 2023-02-12 06:03:17,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d. 2023-02-12 06:03:17,315 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 76756473478f2c8afca1ab066347a4a0 2023-02-12 06:03:17,315 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 77a828f6a35d46d6316183425b87ba6d 2023-02-12 06:03:17,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 77a828f6a35d46d6316183425b87ba6d, disabling compactions & flushes 2023-02-12 06:03:17,315 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d. 2023-02-12 06:03:17,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d. 2023-02-12 06:03:17,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d. after waiting 0 ms 2023-02-12 06:03:17,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d. 2023-02-12 06:03:17,316 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=76756473478f2c8afca1ab066347a4a0, regionState=CLOSED 2023-02-12 06:03:17,316 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676181797316"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181797316"}]},"ts":"1676181797316"} 2023-02-12 06:03:17,317 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=43 2023-02-12 06:03:17,317 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=43, state=SUCCESS; CloseRegionProcedure 530f05fe8dbd50117feed5e471b6c59e, server=jenkins-hbase4.apache.org,33593,1676181791587 in 174 msec 2023-02-12 06:03:17,318 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=530f05fe8dbd50117feed5e471b6c59e, UNASSIGN in 183 msec 2023-02-12 06:03:17,319 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=37 2023-02-12 06:03:17,319 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=37, state=SUCCESS; CloseRegionProcedure 76756473478f2c8afca1ab066347a4a0, server=jenkins-hbase4.apache.org,41035,1676181791508 in 177 msec 2023-02-12 06:03:17,320 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=76756473478f2c8afca1ab066347a4a0, UNASSIGN in 185 msec 2023-02-12 06:03:17,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 06:03:17,324 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d. 2023-02-12 06:03:17,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 36c2a20d70c505da7da65238cdb01a2d: Waiting for close lock at 1676181797314Running coprocessor pre-close hooks at 1676181797314Disabling compacts and flushes for region at 1676181797314Disabling writes for close at 1676181797314Writing region close event to WAL at 1676181797320 (+6 ms)Running coprocessor post-close hooks at 1676181797324 (+4 ms)Closed at 1676181797324 2023-02-12 06:03:17,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 06:03:17,326 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d. 2023-02-12 06:03:17,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 77a828f6a35d46d6316183425b87ba6d: Waiting for close lock at 1676181797315Running coprocessor pre-close hooks at 1676181797315Disabling compacts and flushes for region at 1676181797315Disabling writes for close at 1676181797316 (+1 ms)Writing region close event to WAL at 1676181797321 (+5 ms)Running coprocessor post-close hooks at 1676181797326 (+5 ms)Closed at 1676181797326 2023-02-12 06:03:17,326 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 36c2a20d70c505da7da65238cdb01a2d 2023-02-12 06:03:17,326 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 133d67c01c34b4394253d055b1241449 2023-02-12 06:03:17,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 133d67c01c34b4394253d055b1241449, disabling compactions & flushes 2023-02-12 06:03:17,326 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=36c2a20d70c505da7da65238cdb01a2d, regionState=CLOSED 2023-02-12 06:03:17,326 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676181792831.133d67c01c34b4394253d055b1241449. 2023-02-12 06:03:17,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676181792831.133d67c01c34b4394253d055b1241449. 2023-02-12 06:03:17,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676181792831.133d67c01c34b4394253d055b1241449. after waiting 0 ms 2023-02-12 06:03:17,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676181792831.133d67c01c34b4394253d055b1241449. 2023-02-12 06:03:17,326 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676181797326"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181797326"}]},"ts":"1676181797326"} 2023-02-12 06:03:17,327 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 77a828f6a35d46d6316183425b87ba6d 2023-02-12 06:03:17,327 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close c9e3aa687caae91031a86b0af14dbc7b 2023-02-12 06:03:17,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c9e3aa687caae91031a86b0af14dbc7b, disabling compactions & flushes 2023-02-12 06:03:17,328 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b. 2023-02-12 06:03:17,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b. 2023-02-12 06:03:17,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b. after waiting 0 ms 2023-02-12 06:03:17,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b. 2023-02-12 06:03:17,328 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=77a828f6a35d46d6316183425b87ba6d, regionState=CLOSED 2023-02-12 06:03:17,328 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676181797328"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181797328"}]},"ts":"1676181797328"} 2023-02-12 06:03:17,330 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=38 2023-02-12 06:03:17,330 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=38, state=SUCCESS; CloseRegionProcedure 36c2a20d70c505da7da65238cdb01a2d, server=jenkins-hbase4.apache.org,33593,1676181791587 in 187 msec 2023-02-12 06:03:17,331 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=40 2023-02-12 06:03:17,331 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=40, state=SUCCESS; CloseRegionProcedure 77a828f6a35d46d6316183425b87ba6d, server=jenkins-hbase4.apache.org,41035,1676181791508 in 183 msec 2023-02-12 06:03:17,331 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=36c2a20d70c505da7da65238cdb01a2d, UNASSIGN in 196 msec 2023-02-12 06:03:17,332 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=77a828f6a35d46d6316183425b87ba6d, UNASSIGN in 197 msec 2023-02-12 06:03:17,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/c9e3aa687caae91031a86b0af14dbc7b/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-12 06:03:17,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 06:03:17,335 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b. 2023-02-12 06:03:17,335 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676181792831.133d67c01c34b4394253d055b1241449. 2023-02-12 06:03:17,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c9e3aa687caae91031a86b0af14dbc7b: Waiting for close lock at 1676181797328Running coprocessor pre-close hooks at 1676181797328Disabling compacts and flushes for region at 1676181797328Disabling writes for close at 1676181797328Writing region close event to WAL at 1676181797332 (+4 ms)Running coprocessor post-close hooks at 1676181797335 (+3 ms)Closed at 1676181797335 2023-02-12 06:03:17,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 133d67c01c34b4394253d055b1241449: Waiting for close lock at 1676181797326Running coprocessor pre-close hooks at 1676181797326Disabling compacts and flushes for region at 1676181797326Disabling writes for close at 1676181797326Writing region close event to WAL at 1676181797332 (+6 ms)Running coprocessor post-close hooks at 1676181797335 (+3 ms)Closed at 1676181797335 2023-02-12 06:03:17,337 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed c9e3aa687caae91031a86b0af14dbc7b 2023-02-12 06:03:17,337 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=c9e3aa687caae91031a86b0af14dbc7b, regionState=CLOSED 2023-02-12 06:03:17,337 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676181797337"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181797337"}]},"ts":"1676181797337"} 2023-02-12 06:03:17,337 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 133d67c01c34b4394253d055b1241449 2023-02-12 06:03:17,338 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=133d67c01c34b4394253d055b1241449, regionState=CLOSED 2023-02-12 06:03:17,338 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676181792831.133d67c01c34b4394253d055b1241449.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676181797338"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181797338"}]},"ts":"1676181797338"} 2023-02-12 06:03:17,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-12 06:03:17,340 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=34 2023-02-12 06:03:17,340 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=34, state=SUCCESS; CloseRegionProcedure c9e3aa687caae91031a86b0af14dbc7b, server=jenkins-hbase4.apache.org,41035,1676181791508 in 187 msec 2023-02-12 06:03:17,341 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=39 2023-02-12 06:03:17,341 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=39, state=SUCCESS; CloseRegionProcedure 133d67c01c34b4394253d055b1241449, server=jenkins-hbase4.apache.org,33593,1676181791587 in 192 msec 2023-02-12 06:03:17,341 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=c9e3aa687caae91031a86b0af14dbc7b, UNASSIGN in 206 msec 2023-02-12 06:03:17,342 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=33 2023-02-12 06:03:17,342 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=133d67c01c34b4394253d055b1241449, UNASSIGN in 207 msec 2023-02-12 06:03:17,343 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676181797343"}]},"ts":"1676181797343"} 2023-02-12 06:03:17,344 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-12 06:03:17,402 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-12 06:03:17,406 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 371 msec 2023-02-12 06:03:17,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-12 06:03:17,641 INFO [Listener at localhost/46353] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-12 06:03:17,642 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceMultiRegion 2023-02-12 06:03:17,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:17,645 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:17,646 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:17,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-12 06:03:17,657 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/c9e3aa687caae91031a86b0af14dbc7b 2023-02-12 06:03:17,657 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80 2023-02-12 06:03:17,657 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0 2023-02-12 06:03:17,657 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b 2023-02-12 06:03:17,657 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d 2023-02-12 06:03:17,657 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d 2023-02-12 06:03:17,658 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc 2023-02-12 06:03:17,657 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449 2023-02-12 06:03:17,662 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/f1, FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/f2, FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/recovered.edits] 2023-02-12 06:03:17,663 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/f1, FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/f2, FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/recovered.edits] 2023-02-12 06:03:17,663 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/c9e3aa687caae91031a86b0af14dbc7b/f1, FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/c9e3aa687caae91031a86b0af14dbc7b/f2, FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/c9e3aa687caae91031a86b0af14dbc7b/recovered.edits] 2023-02-12 06:03:17,663 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/f1, FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/f2, FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/recovered.edits] 2023-02-12 06:03:17,664 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/f1, FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/f2, FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/recovered.edits] 2023-02-12 06:03:17,664 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/f1, FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/f2, FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/recovered.edits] 2023-02-12 06:03:17,664 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/f1, FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/f2, FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/recovered.edits] 2023-02-12 06:03:17,664 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/f1, FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/f2, FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/recovered.edits] 2023-02-12 06:03:17,672 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/f1/46b3fb1c61ff4dbabeaf2a6f48515640 to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/f1/46b3fb1c61ff4dbabeaf2a6f48515640 2023-02-12 06:03:17,672 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/f1/8bcd7cf3a2f04c4cacb1fa285bc0a24b to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/f1/8bcd7cf3a2f04c4cacb1fa285bc0a24b 2023-02-12 06:03:17,673 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/f1/328d727c31ee467cbf673aa9e49d5765 to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/f1/328d727c31ee467cbf673aa9e49d5765 2023-02-12 06:03:17,674 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/f1/176237e658ce4e5c90cab7f6350fc968 to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/f1/176237e658ce4e5c90cab7f6350fc968 2023-02-12 06:03:17,674 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/f1/05a3907316834a66b9d2a4a881c4a24c to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/f1/05a3907316834a66b9d2a4a881c4a24c 2023-02-12 06:03:17,674 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/f1/06a9683daae0462fa2912dbc5f07461e to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/f1/06a9683daae0462fa2912dbc5f07461e 2023-02-12 06:03:17,675 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/f1/057bca0e14364bdaadbce066f8ada43e to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/f1/057bca0e14364bdaadbce066f8ada43e 2023-02-12 06:03:17,675 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/c9e3aa687caae91031a86b0af14dbc7b/recovered.edits/6.seqid to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/c9e3aa687caae91031a86b0af14dbc7b/recovered.edits/6.seqid 2023-02-12 06:03:17,676 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/f1/6a40b939d810444db0b9ae1c7bda56e7 to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/f1/6a40b939d810444db0b9ae1c7bda56e7 2023-02-12 06:03:17,676 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/c9e3aa687caae91031a86b0af14dbc7b 2023-02-12 06:03:17,676 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819 2023-02-12 06:03:17,677 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/f1/7e0d41db2f15422f99136a86786ad9c7 to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/f1/7e0d41db2f15422f99136a86786ad9c7 2023-02-12 06:03:17,677 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/f1/df193a96811949fea9c667f090d8daed to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/f1/df193a96811949fea9c667f090d8daed 2023-02-12 06:03:17,677 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/f1/3af97bbcb8874ab797081d2e066c1b88 to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/f1/3af97bbcb8874ab797081d2e066c1b88 2023-02-12 06:03:17,677 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/f1/c6eaf0a2e96540d09d8a3b25e52ac0a5 to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/f1/c6eaf0a2e96540d09d8a3b25e52ac0a5 2023-02-12 06:03:17,679 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/f1/5ecd0027248444cda169180d9f1fa4fa to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/f1/5ecd0027248444cda169180d9f1fa4fa 2023-02-12 06:03:17,679 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/f1/b66b61dc87ab475bb9dd8b442d40b08b to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/f1/b66b61dc87ab475bb9dd8b442d40b08b 2023-02-12 06:03:17,680 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/f1, FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/f2, FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/recovered.edits] 2023-02-12 06:03:17,681 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/f2/3f364f7b2fe14196baefa760efe65d74 to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/f2/3f364f7b2fe14196baefa760efe65d74 2023-02-12 06:03:17,682 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/f2/2b48ed4a8ba440e499627f94d9da10e5 to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/f2/2b48ed4a8ba440e499627f94d9da10e5 2023-02-12 06:03:17,682 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/f2/bbe96aa49e0a4b26ac1eaad6e50d9b95 to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/f2/bbe96aa49e0a4b26ac1eaad6e50d9b95 2023-02-12 06:03:17,683 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/f2/71ce04a481d64ffd9faf486130c88898 to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/f2/71ce04a481d64ffd9faf486130c88898 2023-02-12 06:03:17,683 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/f2/24d7a82e17e14f00ae6634dfb4a31d0c to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/f2/24d7a82e17e14f00ae6634dfb4a31d0c 2023-02-12 06:03:17,684 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/f2/737f282067b74816baf7532822744639 to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/f2/737f282067b74816baf7532822744639 2023-02-12 06:03:17,686 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/f2/8755b9d62b29447a88c673100ec1fe73 to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/f2/8755b9d62b29447a88c673100ec1fe73 2023-02-12 06:03:17,686 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/f2/4ac61190eb85409a8475ab4ad9e685f6 to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/f2/4ac61190eb85409a8475ab4ad9e685f6 2023-02-12 06:03:17,686 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/f2/d536f1d0a53a4c5886641fa90a7f1417 to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/f2/d536f1d0a53a4c5886641fa90a7f1417 2023-02-12 06:03:17,686 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/f2/7997c088a92b4745b8258b963575b023 to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/f2/7997c088a92b4745b8258b963575b023 2023-02-12 06:03:17,687 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/f2/7b61b08e69884f55b7fc4527f7a19f41 to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/f2/7b61b08e69884f55b7fc4527f7a19f41 2023-02-12 06:03:17,688 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/f2/f33681d6fa4f442daf16d37a3d7b3231 to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/f2/f33681d6fa4f442daf16d37a3d7b3231 2023-02-12 06:03:17,689 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/f2/85d74dd407604825ab015d4371bbda74 to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/f2/85d74dd407604825ab015d4371bbda74 2023-02-12 06:03:17,689 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/f2/6c20a7b29b8443c78c81ef9262cf1e09 to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/f2/6c20a7b29b8443c78c81ef9262cf1e09 2023-02-12 06:03:17,691 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/recovered.edits/12.seqid to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0/recovered.edits/12.seqid 2023-02-12 06:03:17,692 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/recovered.edits/12.seqid to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d/recovered.edits/12.seqid 2023-02-12 06:03:17,692 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/f1/1959035159db463d8630aad23b311c80 to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/f1/1959035159db463d8630aad23b311c80 2023-02-12 06:03:17,692 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/76756473478f2c8afca1ab066347a4a0 2023-02-12 06:03:17,692 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/530f05fe8dbd50117feed5e471b6c59e 2023-02-12 06:03:17,693 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/recovered.edits/12.seqid to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc/recovered.edits/12.seqid 2023-02-12 06:03:17,693 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/36c2a20d70c505da7da65238cdb01a2d 2023-02-12 06:03:17,693 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/3f09441dd1b0444e613ff01a617719fc 2023-02-12 06:03:17,694 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/recovered.edits/12.seqid to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d/recovered.edits/12.seqid 2023-02-12 06:03:17,695 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/530f05fe8dbd50117feed5e471b6c59e/f1, FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/530f05fe8dbd50117feed5e471b6c59e/f2, FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/530f05fe8dbd50117feed5e471b6c59e/recovered.edits] 2023-02-12 06:03:17,695 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/77a828f6a35d46d6316183425b87ba6d 2023-02-12 06:03:17,695 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/recovered.edits/12.seqid to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449/recovered.edits/12.seqid 2023-02-12 06:03:17,695 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/f1/24fabd0d558441909781aabad3a096d5 to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/f1/24fabd0d558441909781aabad3a096d5 2023-02-12 06:03:17,696 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/recovered.edits/12.seqid to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80/recovered.edits/12.seqid 2023-02-12 06:03:17,696 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/recovered.edits/12.seqid to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b/recovered.edits/12.seqid 2023-02-12 06:03:17,696 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/133d67c01c34b4394253d055b1241449 2023-02-12 06:03:17,697 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/85f78445f74da16716afdb76512ecb80 2023-02-12 06:03:17,697 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/c7a9336f8bb0a79325c1dfbd145f634b 2023-02-12 06:03:17,699 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/f2/75030c1c6df14e6ebfdfb0c0ecb4b0c6 to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/f2/75030c1c6df14e6ebfdfb0c0ecb4b0c6 2023-02-12 06:03:17,700 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/f2/f777697bc6e84cc6a9aef92bd477a0eb to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/f2/f777697bc6e84cc6a9aef92bd477a0eb 2023-02-12 06:03:17,701 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/530f05fe8dbd50117feed5e471b6c59e/recovered.edits/6.seqid to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/530f05fe8dbd50117feed5e471b6c59e/recovered.edits/6.seqid 2023-02-12 06:03:17,701 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/530f05fe8dbd50117feed5e471b6c59e 2023-02-12 06:03:17,703 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/recovered.edits/12.seqid to hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/archive/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819/recovered.edits/12.seqid 2023-02-12 06:03:17,703 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/.tmp/data/default/testWithMockedMapReduceMultiRegion/1427e4a55ff7e244357b88ef84871819 2023-02-12 06:03:17,704 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-12 06:03:17,706 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:17,709 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-12 06:03:17,711 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-12 06:03:17,712 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:17,712 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-12 06:03:17,713 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676181797712"}]},"ts":"9223372036854775807"} 2023-02-12 06:03:17,713 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676181797712"}]},"ts":"9223372036854775807"} 2023-02-12 06:03:17,713 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676181792831.85f78445f74da16716afdb76512ecb80.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676181797712"}]},"ts":"9223372036854775807"} 2023-02-12 06:03:17,713 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676181797712"}]},"ts":"9223372036854775807"} 2023-02-12 06:03:17,713 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676181797712"}]},"ts":"9223372036854775807"} 2023-02-12 06:03:17,713 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676181792831.133d67c01c34b4394253d055b1241449.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676181797712"}]},"ts":"9223372036854775807"} 2023-02-12 06:03:17,713 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676181797712"}]},"ts":"9223372036854775807"} 2023-02-12 06:03:17,713 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676181797712"}]},"ts":"9223372036854775807"} 2023-02-12 06:03:17,713 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676181797712"}]},"ts":"9223372036854775807"} 2023-02-12 06:03:17,713 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676181797712"}]},"ts":"9223372036854775807"} 2023-02-12 06:03:17,717 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-12 06:03:17,717 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c9e3aa687caae91031a86b0af14dbc7b, NAME => 'testWithMockedMapReduceMultiRegion,,1676181792831.c9e3aa687caae91031a86b0af14dbc7b.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => c7a9336f8bb0a79325c1dfbd145f634b, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676181792831.c7a9336f8bb0a79325c1dfbd145f634b.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 85f78445f74da16716afdb76512ecb80, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676181792831.85f78445f74da16716afdb76512ecb80.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 76756473478f2c8afca1ab066347a4a0, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676181792831.76756473478f2c8afca1ab066347a4a0.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 36c2a20d70c505da7da65238cdb01a2d, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676181792831.36c2a20d70c505da7da65238cdb01a2d.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 133d67c01c34b4394253d055b1241449, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676181792831.133d67c01c34b4394253d055b1241449.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 77a828f6a35d46d6316183425b87ba6d, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676181792831.77a828f6a35d46d6316183425b87ba6d.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 3f09441dd1b0444e613ff01a617719fc, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676181792831.3f09441dd1b0444e613ff01a617719fc.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 1427e4a55ff7e244357b88ef84871819, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676181792831.1427e4a55ff7e244357b88ef84871819.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => 530f05fe8dbd50117feed5e471b6c59e, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676181792831.530f05fe8dbd50117feed5e471b6c59e.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-12 06:03:17,717 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-12 06:03:17,718 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676181797717"}]},"ts":"9223372036854775807"} 2023-02-12 06:03:17,720 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-12 06:03:17,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-12 06:03:17,788 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-12 06:03:17,789 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 146 msec 2023-02-12 06:03:17,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36105] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-12 06:03:17,950 INFO [Listener at localhost/46353] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-12 06:03:17,950 INFO [Listener at localhost/46353] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-12 06:03:17,950 INFO [Listener at localhost/46353] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 06:03:17,950 DEBUG [Listener at localhost/46353] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2d0dd7c5 to 127.0.0.1:54909 2023-02-12 06:03:17,950 DEBUG [Listener at localhost/46353] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:17,950 DEBUG [Listener at localhost/46353] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-12 06:03:17,951 DEBUG [Listener at localhost/46353] util.JVMClusterUtil(257): Found active master hash=379073303, stopped=false 2023-02-12 06:03:17,951 INFO [Listener at localhost/46353] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,36105,1676181791440 2023-02-12 06:03:18,063 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-12 06:03:18,089 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 06:03:18,089 INFO [Listener at localhost/46353] procedure2.ProcedureExecutor(629): Stopping 2023-02-12 06:03:18,089 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): regionserver:33593-0x10047204c7b0002, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 06:03:18,089 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): regionserver:41035-0x10047204c7b0001, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 06:03:18,089 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:18,091 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:03:18,091 DEBUG [Listener at localhost/46353] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c574da9 to 127.0.0.1:54909 2023-02-12 06:03:18,091 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33593-0x10047204c7b0002, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:03:18,091 DEBUG [Listener at localhost/46353] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:18,091 INFO [Listener at localhost/46353] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41035,1676181791508' ***** 2023-02-12 06:03:18,091 INFO [Listener at localhost/46353] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 06:03:18,092 INFO [Listener at localhost/46353] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,33593,1676181791587' ***** 2023-02-12 06:03:18,092 INFO [Listener at localhost/46353] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 06:03:18,091 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41035-0x10047204c7b0001, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:03:18,093 INFO [RS:1;jenkins-hbase4:33593] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 06:03:18,093 INFO [RS:0;jenkins-hbase4:41035] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 06:03:18,093 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 06:03:18,093 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 06:03:18,093 INFO [RS:1;jenkins-hbase4:33593] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 06:03:18,093 INFO [RS:0;jenkins-hbase4:41035] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 06:03:18,095 INFO [RS:1;jenkins-hbase4:33593] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 06:03:18,095 INFO [RS:0;jenkins-hbase4:41035] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 06:03:18,096 INFO [RS:1;jenkins-hbase4:33593] regionserver.HRegionServer(3304): Received CLOSE for 661d0528dccf50bcf6f106de1dd83674 2023-02-12 06:03:18,096 INFO [RS:0;jenkins-hbase4:41035] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:18,096 INFO [RS:1;jenkins-hbase4:33593] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:18,096 DEBUG [RS:0;jenkins-hbase4:41035] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x40946e26 to 127.0.0.1:54909 2023-02-12 06:03:18,096 DEBUG [RS:1;jenkins-hbase4:33593] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4a547229 to 127.0.0.1:54909 2023-02-12 06:03:18,096 DEBUG [RS:0;jenkins-hbase4:41035] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:18,096 DEBUG [RS:1;jenkins-hbase4:33593] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:18,096 INFO [RS:0;jenkins-hbase4:41035] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 06:03:18,096 INFO [RS:0;jenkins-hbase4:41035] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 06:03:18,096 INFO [RS:0;jenkins-hbase4:41035] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 06:03:18,096 INFO [RS:1;jenkins-hbase4:33593] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-12 06:03:18,096 INFO [RS:0;jenkins-hbase4:41035] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-12 06:03:18,096 DEBUG [RS:1;jenkins-hbase4:33593] regionserver.HRegionServer(1479): Online Regions={661d0528dccf50bcf6f106de1dd83674=hbase:namespace,,1676181792165.661d0528dccf50bcf6f106de1dd83674.} 2023-02-12 06:03:18,096 DEBUG [RS:1;jenkins-hbase4:33593] regionserver.HRegionServer(1505): Waiting on 661d0528dccf50bcf6f106de1dd83674 2023-02-12 06:03:18,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 661d0528dccf50bcf6f106de1dd83674, disabling compactions & flushes 2023-02-12 06:03:18,098 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676181792165.661d0528dccf50bcf6f106de1dd83674. 2023-02-12 06:03:18,098 INFO [RS:0;jenkins-hbase4:41035] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-12 06:03:18,098 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676181792165.661d0528dccf50bcf6f106de1dd83674. 2023-02-12 06:03:18,098 DEBUG [RS:0;jenkins-hbase4:41035] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-12 06:03:18,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676181792165.661d0528dccf50bcf6f106de1dd83674. after waiting 2 ms 2023-02-12 06:03:18,100 DEBUG [RS:0;jenkins-hbase4:41035] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-12 06:03:18,100 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 06:03:18,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676181792165.661d0528dccf50bcf6f106de1dd83674. 2023-02-12 06:03:18,100 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 06:03:18,100 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 661d0528dccf50bcf6f106de1dd83674 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-12 06:03:18,100 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 06:03:18,100 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 06:03:18,100 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 06:03:18,100 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.36 KB heapSize=44.48 KB 2023-02-12 06:03:18,113 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/hbase/namespace/661d0528dccf50bcf6f106de1dd83674/.tmp/info/957d60d41b3e4e92b569498cd9799475 2023-02-12 06:03:18,115 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.73 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/hbase/meta/1588230740/.tmp/info/83d327a96a6e4742b127aedafee60912 2023-02-12 06:03:18,118 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/hbase/namespace/661d0528dccf50bcf6f106de1dd83674/.tmp/info/957d60d41b3e4e92b569498cd9799475 as hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/hbase/namespace/661d0528dccf50bcf6f106de1dd83674/info/957d60d41b3e4e92b569498cd9799475 2023-02-12 06:03:18,122 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 83d327a96a6e4742b127aedafee60912 2023-02-12 06:03:18,124 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/hbase/namespace/661d0528dccf50bcf6f106de1dd83674/info/957d60d41b3e4e92b569498cd9799475, entries=2, sequenceid=6, filesize=4.8 K 2023-02-12 06:03:18,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 661d0528dccf50bcf6f106de1dd83674 in 25ms, sequenceid=6, compaction requested=false 2023-02-12 06:03:18,149 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/hbase/meta/1588230740/.tmp/rep_barrier/3151fea3865c4f63a0dd0739ea3d7dc3 2023-02-12 06:03:18,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/hbase/namespace/661d0528dccf50bcf6f106de1dd83674/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-12 06:03:18,151 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676181792165.661d0528dccf50bcf6f106de1dd83674. 2023-02-12 06:03:18,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 661d0528dccf50bcf6f106de1dd83674: Waiting for close lock at 1676181798096Running coprocessor pre-close hooks at 1676181798096Disabling compacts and flushes for region at 1676181798096Disabling writes for close at 1676181798100 (+4 ms)Obtaining lock to block concurrent updates at 1676181798100Preparing flush snapshotting stores in 661d0528dccf50bcf6f106de1dd83674 at 1676181798100Finished memstore snapshotting hbase:namespace,,1676181792165.661d0528dccf50bcf6f106de1dd83674., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676181798100Flushing stores of hbase:namespace,,1676181792165.661d0528dccf50bcf6f106de1dd83674. at 1676181798101 (+1 ms)Flushing 661d0528dccf50bcf6f106de1dd83674/info: creating writer at 1676181798101Flushing 661d0528dccf50bcf6f106de1dd83674/info: appending metadata at 1676181798104 (+3 ms)Flushing 661d0528dccf50bcf6f106de1dd83674/info: closing flushed file at 1676181798104Flushing 661d0528dccf50bcf6f106de1dd83674/info: reopening flushed file at 1676181798119 (+15 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 661d0528dccf50bcf6f106de1dd83674 in 25ms, sequenceid=6, compaction requested=false at 1676181798125 (+6 ms)Writing region close event to WAL at 1676181798138 (+13 ms)Running coprocessor post-close hooks at 1676181798150 (+12 ms)Closed at 1676181798151 (+1 ms) 2023-02-12 06:03:18,151 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676181792165.661d0528dccf50bcf6f106de1dd83674. 2023-02-12 06:03:18,155 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3151fea3865c4f63a0dd0739ea3d7dc3 2023-02-12 06:03:18,166 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/hbase/meta/1588230740/.tmp/table/9ca41320ab874596a3be6deb704a2a01 2023-02-12 06:03:18,171 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9ca41320ab874596a3be6deb704a2a01 2023-02-12 06:03:18,171 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/hbase/meta/1588230740/.tmp/info/83d327a96a6e4742b127aedafee60912 as hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/hbase/meta/1588230740/info/83d327a96a6e4742b127aedafee60912 2023-02-12 06:03:18,173 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 06:03:18,176 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 83d327a96a6e4742b127aedafee60912 2023-02-12 06:03:18,176 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/hbase/meta/1588230740/info/83d327a96a6e4742b127aedafee60912, entries=30, sequenceid=57, filesize=8.3 K 2023-02-12 06:03:18,177 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/hbase/meta/1588230740/.tmp/rep_barrier/3151fea3865c4f63a0dd0739ea3d7dc3 as hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/hbase/meta/1588230740/rep_barrier/3151fea3865c4f63a0dd0739ea3d7dc3 2023-02-12 06:03:18,181 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3151fea3865c4f63a0dd0739ea3d7dc3 2023-02-12 06:03:18,181 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 06:03:18,181 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/hbase/meta/1588230740/rep_barrier/3151fea3865c4f63a0dd0739ea3d7dc3, entries=10, sequenceid=57, filesize=6.1 K 2023-02-12 06:03:18,183 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/hbase/meta/1588230740/.tmp/table/9ca41320ab874596a3be6deb704a2a01 as hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/hbase/meta/1588230740/table/9ca41320ab874596a3be6deb704a2a01 2023-02-12 06:03:18,188 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9ca41320ab874596a3be6deb704a2a01 2023-02-12 06:03:18,188 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/hbase/meta/1588230740/table/9ca41320ab874596a3be6deb704a2a01, entries=13, sequenceid=57, filesize=6.1 K 2023-02-12 06:03:18,189 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 89ms, sequenceid=57, compaction requested=false 2023-02-12 06:03:18,193 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-12 06:03:18,194 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 06:03:18,195 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 06:03:18,195 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676181798098Running coprocessor pre-close hooks at 1676181798098Disabling compacts and flushes for region at 1676181798098Disabling writes for close at 1676181798100 (+2 ms)Obtaining lock to block concurrent updates at 1676181798100Preparing flush snapshotting stores in 1588230740 at 1676181798100Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=29041, getHeapSize=45504, getOffHeapSize=0, getCellsCount=207 at 1676181798101 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1676181798102 (+1 ms)Flushing 1588230740/info: creating writer at 1676181798102Flushing 1588230740/info: appending metadata at 1676181798106 (+4 ms)Flushing 1588230740/info: closing flushed file at 1676181798106Flushing 1588230740/rep_barrier: creating writer at 1676181798123 (+17 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676181798127 (+4 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676181798127Flushing 1588230740/table: creating writer at 1676181798155 (+28 ms)Flushing 1588230740/table: appending metadata at 1676181798157 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676181798157Flushing 1588230740/info: reopening flushed file at 1676181798172 (+15 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676181798178 (+6 ms)Flushing 1588230740/table: reopening flushed file at 1676181798184 (+6 ms)Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 89ms, sequenceid=57, compaction requested=false at 1676181798189 (+5 ms)Writing region close event to WAL at 1676181798190 (+1 ms)Running coprocessor post-close hooks at 1676181798194 (+4 ms)Closed at 1676181798195 (+1 ms) 2023-02-12 06:03:18,195 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-12 06:03:18,296 INFO [RS:1;jenkins-hbase4:33593] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,33593,1676181791587; all regions closed. 2023-02-12 06:03:18,300 INFO [RS:0;jenkins-hbase4:41035] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41035,1676181791508; all regions closed. 2023-02-12 06:03:18,301 DEBUG [RS:1;jenkins-hbase4:33593] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/oldWALs 2023-02-12 06:03:18,301 INFO [RS:1;jenkins-hbase4:33593] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33593%2C1676181791587:(num 1676181792538) 2023-02-12 06:03:18,301 DEBUG [RS:1;jenkins-hbase4:33593] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:18,301 INFO [RS:1;jenkins-hbase4:33593] regionserver.LeaseManager(133): Closed leases 2023-02-12 06:03:18,301 INFO [RS:1;jenkins-hbase4:33593] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-12 06:03:18,301 INFO [RS:1;jenkins-hbase4:33593] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 06:03:18,301 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 06:03:18,301 INFO [RS:1;jenkins-hbase4:33593] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 06:03:18,301 INFO [RS:1;jenkins-hbase4:33593] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 06:03:18,303 INFO [RS:1;jenkins-hbase4:33593] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33593 2023-02-12 06:03:18,305 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): regionserver:33593-0x10047204c7b0002, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:18,305 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): regionserver:33593-0x10047204c7b0002, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 06:03:18,305 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): regionserver:41035-0x10047204c7b0001, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33593,1676181791587 2023-02-12 06:03:18,305 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): regionserver:41035-0x10047204c7b0001, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 06:03:18,305 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 06:03:18,306 DEBUG [RS:0;jenkins-hbase4:41035] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/oldWALs 2023-02-12 06:03:18,306 INFO [RS:0;jenkins-hbase4:41035] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41035%2C1676181791508.meta:.meta(num 1676181792110) 2023-02-12 06:03:18,308 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33593,1676181791587] 2023-02-12 06:03:18,308 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33593,1676181791587; numProcessing=1 2023-02-12 06:03:18,310 DEBUG [RS:0;jenkins-hbase4:41035] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/oldWALs 2023-02-12 06:03:18,310 INFO [RS:0;jenkins-hbase4:41035] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41035%2C1676181791508:(num 1676181792897) 2023-02-12 06:03:18,310 DEBUG [RS:0;jenkins-hbase4:41035] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:18,310 INFO [RS:0;jenkins-hbase4:41035] regionserver.LeaseManager(133): Closed leases 2023-02-12 06:03:18,310 INFO [RS:0;jenkins-hbase4:41035] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-12 06:03:18,311 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 06:03:18,312 INFO [RS:0;jenkins-hbase4:41035] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41035 2023-02-12 06:03:18,408 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): regionserver:33593-0x10047204c7b0002, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:03:18,408 INFO [RS:1;jenkins-hbase4:33593] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,33593,1676181791587; zookeeper connection closed. 2023-02-12 06:03:18,408 ERROR [Listener at localhost/46353-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@92311b9 rejected from java.util.concurrent.ThreadPoolExecutor@d1c9445[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:18,408 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): regionserver:33593-0x10047204c7b0002, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:03:18,408 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@417b15d8] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@417b15d8 2023-02-12 06:03:18,408 ERROR [Listener at localhost/46353-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@68a358e3 rejected from java.util.concurrent.ThreadPoolExecutor@d1c9445[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:18,409 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): regionserver:41035-0x10047204c7b0001, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41035,1676181791508 2023-02-12 06:03:18,409 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33593,1676181791587 already deleted, retry=false 2023-02-12 06:03:18,409 ERROR [Listener at localhost/46353-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2288182c rejected from java.util.concurrent.ThreadPoolExecutor@26b798a5[Shutting down, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:18,409 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 06:03:18,409 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33593,1676181791587 expired; onlineServers=1 2023-02-12 06:03:18,411 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41035,1676181791508] 2023-02-12 06:03:18,411 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41035,1676181791508; numProcessing=2 2023-02-12 06:03:18,412 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41035,1676181791508 already deleted, retry=false 2023-02-12 06:03:18,412 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41035,1676181791508 expired; onlineServers=0 2023-02-12 06:03:18,412 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36105,1676181791440' ***** 2023-02-12 06:03:18,412 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-12 06:03:18,414 DEBUG [M:0;jenkins-hbase4:36105] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12a7b51c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 06:03:18,414 INFO [M:0;jenkins-hbase4:36105] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36105,1676181791440 2023-02-12 06:03:18,414 INFO [M:0;jenkins-hbase4:36105] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36105,1676181791440; all regions closed. 2023-02-12 06:03:18,414 DEBUG [M:0;jenkins-hbase4:36105] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:18,414 DEBUG [M:0;jenkins-hbase4:36105] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-12 06:03:18,414 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-12 06:03:18,414 DEBUG [M:0;jenkins-hbase4:36105] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-12 06:03:18,414 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676181791751] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676181791751,5,FailOnTimeoutGroup] 2023-02-12 06:03:18,414 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676181791752] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676181791752,5,FailOnTimeoutGroup] 2023-02-12 06:03:18,414 INFO [M:0;jenkins-hbase4:36105] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-12 06:03:18,415 INFO [M:0;jenkins-hbase4:36105] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-12 06:03:18,415 INFO [M:0;jenkins-hbase4:36105] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-12 06:03:18,415 DEBUG [M:0;jenkins-hbase4:36105] master.HMaster(1502): Stopping service threads 2023-02-12 06:03:18,415 INFO [M:0;jenkins-hbase4:36105] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-12 06:03:18,416 ERROR [M:0;jenkins-hbase4:36105] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-12 06:03:18,416 INFO [M:0;jenkins-hbase4:36105] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-12 06:03:18,416 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-12 06:03:18,416 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-12 06:03:18,416 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:18,417 DEBUG [M:0;jenkins-hbase4:36105] zookeeper.ZKUtil(398): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-12 06:03:18,417 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 06:03:18,417 WARN [M:0;jenkins-hbase4:36105] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-12 06:03:18,417 INFO [M:0;jenkins-hbase4:36105] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-12 06:03:18,417 INFO [M:0;jenkins-hbase4:36105] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-12 06:03:18,417 DEBUG [M:0;jenkins-hbase4:36105] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 06:03:18,417 INFO [M:0;jenkins-hbase4:36105] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:18,418 DEBUG [M:0;jenkins-hbase4:36105] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:18,418 DEBUG [M:0;jenkins-hbase4:36105] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 06:03:18,418 DEBUG [M:0;jenkins-hbase4:36105] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:18,418 INFO [M:0;jenkins-hbase4:36105] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.11 KB heapSize=200.02 KB 2023-02-12 06:03:18,427 INFO [M:0;jenkins-hbase4:36105] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.11 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6cfd5bda07a74baf97df5c95f7166d53 2023-02-12 06:03:18,431 DEBUG [M:0;jenkins-hbase4:36105] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6cfd5bda07a74baf97df5c95f7166d53 as hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6cfd5bda07a74baf97df5c95f7166d53 2023-02-12 06:03:18,434 INFO [M:0;jenkins-hbase4:36105] regionserver.HStore(1080): Added hdfs://localhost:45441/user/jenkins/test-data/f47283a9-71b3-44e3-71ec-92a7ef34984a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6cfd5bda07a74baf97df5c95f7166d53, entries=53, sequenceid=357, filesize=10.7 K 2023-02-12 06:03:18,435 INFO [M:0;jenkins-hbase4:36105] regionserver.HRegion(2947): Finished flush of dataSize ~167.11 KB/171119, heapSize ~200 KB/204800, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=357, compaction requested=false 2023-02-12 06:03:18,436 INFO [M:0;jenkins-hbase4:36105] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:18,436 DEBUG [M:0;jenkins-hbase4:36105] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676181798417Disabling compacts and flushes for region at 1676181798417Disabling writes for close at 1676181798418 (+1 ms)Obtaining lock to block concurrent updates at 1676181798418Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676181798418Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=171119, getHeapSize=204800, getOffHeapSize=0, getCellsCount=442 at 1676181798418Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676181798419 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676181798419Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676181798422 (+3 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676181798422Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676181798432 (+10 ms)Finished flush of dataSize ~167.11 KB/171119, heapSize ~200 KB/204800, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=357, compaction requested=false at 1676181798435 (+3 ms)Writing region close event to WAL at 1676181798436 (+1 ms)Closed at 1676181798436 2023-02-12 06:03:18,438 INFO [M:0;jenkins-hbase4:36105] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-12 06:03:18,438 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 06:03:18,439 INFO [M:0;jenkins-hbase4:36105] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36105 2023-02-12 06:03:18,441 DEBUG [M:0;jenkins-hbase4:36105] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,36105,1676181791440 already deleted, retry=false 2023-02-12 06:03:18,529 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): regionserver:41035-0x10047204c7b0001, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:03:18,529 INFO [RS:0;jenkins-hbase4:41035] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41035,1676181791508; zookeeper connection closed. 2023-02-12 06:03:18,529 ERROR [Listener at localhost/46353-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@30b794ef rejected from java.util.concurrent.ThreadPoolExecutor@26b798a5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:18,529 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): regionserver:41035-0x10047204c7b0001, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:03:18,529 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7bf5bd6e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7bf5bd6e 2023-02-12 06:03:18,529 ERROR [Listener at localhost/46353-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@48746beb rejected from java.util.concurrent.ThreadPoolExecutor@26b798a5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:18,529 INFO [Listener at localhost/46353] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-12 06:03:18,629 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:03:18,629 INFO [M:0;jenkins-hbase4:36105] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36105,1676181791440; zookeeper connection closed. 2023-02-12 06:03:18,629 ERROR [Listener at localhost/46353-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1f598167 rejected from java.util.concurrent.ThreadPoolExecutor@1b661654[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:18,630 DEBUG [Listener at localhost/46353-EventThread] zookeeper.ZKWatcher(600): master:36105-0x10047204c7b0000, quorum=127.0.0.1:54909, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:03:18,630 WARN [Listener at localhost/46353] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 06:03:18,630 ERROR [Listener at localhost/46353-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3cf1bae9 rejected from java.util.concurrent.ThreadPoolExecutor@1b661654[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:18,634 INFO [Listener at localhost/46353] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 06:03:18,741 WARN [BP-383254642-172.31.14.131-1676181790810 heartbeating to localhost/127.0.0.1:45441] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 06:03:18,742 WARN [BP-383254642-172.31.14.131-1676181790810 heartbeating to localhost/127.0.0.1:45441] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-383254642-172.31.14.131-1676181790810 (Datanode Uuid d10e44f1-738d-414f-8e69-cc56229498fe) service to localhost/127.0.0.1:45441 2023-02-12 06:03:18,742 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a2a4180-fc2e-d892-681d-2c4f0723a476/cluster_f966ec53-e0ed-65ac-4846-e0b979a5b974/dfs/data/data3/current/BP-383254642-172.31.14.131-1676181790810] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 06:03:18,742 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a2a4180-fc2e-d892-681d-2c4f0723a476/cluster_f966ec53-e0ed-65ac-4846-e0b979a5b974/dfs/data/data4/current/BP-383254642-172.31.14.131-1676181790810] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 06:03:18,744 WARN [Listener at localhost/46353] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 06:03:18,748 INFO [Listener at localhost/46353] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 06:03:18,854 WARN [BP-383254642-172.31.14.131-1676181790810 heartbeating to localhost/127.0.0.1:45441] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 06:03:18,854 WARN [BP-383254642-172.31.14.131-1676181790810 heartbeating to localhost/127.0.0.1:45441] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-383254642-172.31.14.131-1676181790810 (Datanode Uuid f55c5f93-1f5a-4d6a-ab9d-bd822f6004e9) service to localhost/127.0.0.1:45441 2023-02-12 06:03:18,855 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a2a4180-fc2e-d892-681d-2c4f0723a476/cluster_f966ec53-e0ed-65ac-4846-e0b979a5b974/dfs/data/data1/current/BP-383254642-172.31.14.131-1676181790810] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 06:03:18,855 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a2a4180-fc2e-d892-681d-2c4f0723a476/cluster_f966ec53-e0ed-65ac-4846-e0b979a5b974/dfs/data/data2/current/BP-383254642-172.31.14.131-1676181790810] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 06:03:18,864 INFO [Listener at localhost/46353] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 06:03:18,985 INFO [Listener at localhost/46353] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-12 06:03:19,023 INFO [Listener at localhost/46353] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-12 06:03:19,037 INFO [Listener at localhost/46353] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=231 (was 180) Potentially hanging thread: Listener at localhost/46353.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost:45441 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/46353.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/46353 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/46353.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:45441 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost:45441 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:45441 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins@localhost:45441 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/46353.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/46353.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/46353.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/46353.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/46353.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-17-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,36105,1676181791440)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:45441 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/46353.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:45441 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/46353.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) - Thread LEAK? -, OpenFileDescriptor=635 (was 571) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=340 (was 321) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=4258 (was 4314) 2023-02-12 06:03:19,048 INFO [Listener at localhost/46353] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=231, OpenFileDescriptor=635, MaxFileDescriptor=60000, SystemLoadAverage=340, ProcessCount=166, AvailableMemoryMB=4257 2023-02-12 06:03:19,059 INFO [Listener at localhost/46353] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a2a4180-fc2e-d892-681d-2c4f0723a476/hadoop.log.dir so I do NOT create it in target/test-data/eeaa41e4-1e8e-b395-e319-cb5bb6b2cf7e 2023-02-12 06:03:19,059 WARN [Listener at localhost/46353] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a2a4180-fc2e-d892-681d-2c4f0723a476/hadoop.log.dir Erasing configuration value by system value. 2023-02-12 06:03:19,059 INFO [Listener at localhost/46353] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a2a4180-fc2e-d892-681d-2c4f0723a476/hadoop.tmp.dir so I do NOT create it in target/test-data/eeaa41e4-1e8e-b395-e319-cb5bb6b2cf7e 2023-02-12 06:03:19,059 WARN [Listener at localhost/46353] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4a2a4180-fc2e-d892-681d-2c4f0723a476/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-12 06:03:19,059 DEBUG [Listener at localhost/46353] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eeaa41e4-1e8e-b395-e319-cb5bb6b2cf7e 2023-02-12 06:03:19,059 INFO [Listener at localhost/46353] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-12 06:03:19,059 INFO [Listener at localhost/46353] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eeaa41e4-1e8e-b395-e319-cb5bb6b2cf7e/cluster_625104e1-d58b-2d05-4e31-b7c68e58d9d4, deleteOnExit=true 2023-02-12 06:03:19,059 INFO [Listener at localhost/46353] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-12 06:03:19,059 INFO [Listener at localhost/46353] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eeaa41e4-1e8e-b395-e319-cb5bb6b2cf7e/test.cache.data in system properties and HBase conf 2023-02-12 06:03:19,060 INFO [Listener at localhost/46353] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eeaa41e4-1e8e-b395-e319-cb5bb6b2cf7e/hadoop.tmp.dir in system properties and HBase conf 2023-02-12 06:03:19,060 INFO [Listener at localhost/46353] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eeaa41e4-1e8e-b395-e319-cb5bb6b2cf7e/hadoop.log.dir in system properties and HBase conf 2023-02-12 06:03:19,060 INFO [Listener at localhost/46353] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eeaa41e4-1e8e-b395-e319-cb5bb6b2cf7e/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-12 06:03:19,060 INFO [Listener at localhost/46353] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eeaa41e4-1e8e-b395-e319-cb5bb6b2cf7e/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-12 06:03:19,060 INFO [Listener at localhost/46353] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-12 06:03:19,060 DEBUG [Listener at localhost/46353] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-12 06:03:19,060 INFO [Listener at localhost/46353] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eeaa41e4-1e8e-b395-e319-cb5bb6b2cf7e/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-12 06:03:19,060 INFO [Listener at localhost/46353] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eeaa41e4-1e8e-b395-e319-cb5bb6b2cf7e/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-12 06:03:19,060 INFO [Listener at localhost/46353] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eeaa41e4-1e8e-b395-e319-cb5bb6b2cf7e/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-12 06:03:19,061 INFO [Listener at localhost/46353] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eeaa41e4-1e8e-b395-e319-cb5bb6b2cf7e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 06:03:19,061 INFO [Listener at localhost/46353] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eeaa41e4-1e8e-b395-e319-cb5bb6b2cf7e/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-12 06:03:19,061 INFO [Listener at localhost/46353] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eeaa41e4-1e8e-b395-e319-cb5bb6b2cf7e/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-12 06:03:19,061 INFO [Listener at localhost/46353] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eeaa41e4-1e8e-b395-e319-cb5bb6b2cf7e/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 06:03:19,061 INFO [Listener at localhost/46353] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eeaa41e4-1e8e-b395-e319-cb5bb6b2cf7e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 06:03:19,061 INFO [Listener at localhost/46353] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eeaa41e4-1e8e-b395-e319-cb5bb6b2cf7e/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-12 06:03:19,061 INFO [Listener at localhost/46353] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eeaa41e4-1e8e-b395-e319-cb5bb6b2cf7e/nfs.dump.dir in system properties and HBase conf 2023-02-12 06:03:19,061 INFO [Listener at localhost/46353] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eeaa41e4-1e8e-b395-e319-cb5bb6b2cf7e/java.io.tmpdir in system properties and HBase conf 2023-02-12 06:03:19,061 INFO [Listener at localhost/46353] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eeaa41e4-1e8e-b395-e319-cb5bb6b2cf7e/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 06:03:19,061 INFO [Listener at localhost/46353] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eeaa41e4-1e8e-b395-e319-cb5bb6b2cf7e/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-12 06:03:19,061 INFO [Listener at localhost/46353] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eeaa41e4-1e8e-b395-e319-cb5bb6b2cf7e/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-12 06:03:19,066 WARN [Listener at localhost/46353] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 06:03:19,066 WARN [Listener at localhost/46353] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 06:03:19,113 WARN [Listener at localhost/46353] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 06:03:19,116 INFO [Listener at localhost/46353] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 06:03:19,123 INFO [Listener at localhost/46353] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eeaa41e4-1e8e-b395-e319-cb5bb6b2cf7e/java.io.tmpdir/Jetty_localhost_44223_hdfs____.vhkjqb/webapp 2023-02-12 06:03:19,215 INFO [Listener at localhost/46353] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44223 2023-02-12 06:03:19,219 WARN [Listener at localhost/46353] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 06:03:19,220 WARN [Listener at localhost/46353] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 06:03:19,259 WARN [Listener at localhost/35673] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 06:03:19,275 WARN [Listener at localhost/35673] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 06:03:19,278 WARN [Listener at localhost/35673] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 06:03:19,280 INFO [Listener at localhost/35673] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 06:03:19,287 INFO [Listener at localhost/35673] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eeaa41e4-1e8e-b395-e319-cb5bb6b2cf7e/java.io.tmpdir/Jetty_localhost_32889_datanode____.89ej6n/webapp 2023-02-12 06:03:19,388 INFO [Listener at localhost/35673] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:32889 2023-02-12 06:03:19,395 WARN [Listener at localhost/41439] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 06:03:19,413 WARN [Listener at localhost/41439] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 06:03:19,415 WARN [Listener at localhost/41439] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 06:03:19,416 INFO [Listener at localhost/41439] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 06:03:19,421 INFO [Listener at localhost/41439] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eeaa41e4-1e8e-b395-e319-cb5bb6b2cf7e/java.io.tmpdir/Jetty_localhost_42173_datanode____j4qz1y/webapp 2023-02-12 06:03:19,489 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x63624fe28f096982: Processing first storage report for DS-f25d0f35-74b5-4fbf-a357-17e5e65e49df from datanode 24844f80-f06f-43c6-858c-12d801cd0972 2023-02-12 06:03:19,489 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x63624fe28f096982: from storage DS-f25d0f35-74b5-4fbf-a357-17e5e65e49df node DatanodeRegistration(127.0.0.1:45349, datanodeUuid=24844f80-f06f-43c6-858c-12d801cd0972, infoPort=41297, infoSecurePort=0, ipcPort=41439, storageInfo=lv=-57;cid=testClusterID;nsid=1882924089;c=1676181799068), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 06:03:19,489 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x63624fe28f096982: Processing first storage report for DS-211d6c8b-c75d-4852-b707-10b74c7df359 from datanode 24844f80-f06f-43c6-858c-12d801cd0972 2023-02-12 06:03:19,489 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x63624fe28f096982: from storage DS-211d6c8b-c75d-4852-b707-10b74c7df359 node DatanodeRegistration(127.0.0.1:45349, datanodeUuid=24844f80-f06f-43c6-858c-12d801cd0972, infoPort=41297, infoSecurePort=0, ipcPort=41439, storageInfo=lv=-57;cid=testClusterID;nsid=1882924089;c=1676181799068), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 06:03:19,518 INFO [Listener at localhost/41439] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42173 2023-02-12 06:03:19,526 WARN [Listener at localhost/46459] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 06:03:19,629 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x614cae715a243f45: Processing first storage report for DS-05a68eeb-d714-4b9d-865e-ab6ca11e71b4 from datanode f4955237-fe9e-47f4-bb97-ee7a84d82dc9 2023-02-12 06:03:19,629 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x614cae715a243f45: from storage DS-05a68eeb-d714-4b9d-865e-ab6ca11e71b4 node DatanodeRegistration(127.0.0.1:39465, datanodeUuid=f4955237-fe9e-47f4-bb97-ee7a84d82dc9, infoPort=37779, infoSecurePort=0, ipcPort=46459, storageInfo=lv=-57;cid=testClusterID;nsid=1882924089;c=1676181799068), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 06:03:19,629 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x614cae715a243f45: Processing first storage report for DS-8f727776-f8bf-4754-8e4a-706150717e4a from datanode f4955237-fe9e-47f4-bb97-ee7a84d82dc9 2023-02-12 06:03:19,629 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x614cae715a243f45: from storage DS-8f727776-f8bf-4754-8e4a-706150717e4a node DatanodeRegistration(127.0.0.1:39465, datanodeUuid=f4955237-fe9e-47f4-bb97-ee7a84d82dc9, infoPort=37779, infoSecurePort=0, ipcPort=46459, storageInfo=lv=-57;cid=testClusterID;nsid=1882924089;c=1676181799068), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 06:03:19,634 DEBUG [Listener at localhost/46459] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eeaa41e4-1e8e-b395-e319-cb5bb6b2cf7e 2023-02-12 06:03:19,636 INFO [Listener at localhost/46459] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eeaa41e4-1e8e-b395-e319-cb5bb6b2cf7e/cluster_625104e1-d58b-2d05-4e31-b7c68e58d9d4/zookeeper_0, clientPort=53582, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eeaa41e4-1e8e-b395-e319-cb5bb6b2cf7e/cluster_625104e1-d58b-2d05-4e31-b7c68e58d9d4/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eeaa41e4-1e8e-b395-e319-cb5bb6b2cf7e/cluster_625104e1-d58b-2d05-4e31-b7c68e58d9d4/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-12 06:03:19,637 INFO [Listener at localhost/46459] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=53582 2023-02-12 06:03:19,637 INFO [Listener at localhost/46459] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:19,638 INFO [Listener at localhost/46459] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:19,652 INFO [Listener at localhost/46459] util.FSUtils(479): Created version file at hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944 with version=8 2023-02-12 06:03:19,652 INFO [Listener at localhost/46459] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:19,653 INFO [Listener at localhost/46459] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:19,654 INFO [Listener at localhost/46459] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35673/user/jenkins/test-data/a566fe58-e016-9912-6a3a-f700cc6beee9/hbase-staging 2023-02-12 06:03:19,656 INFO [Listener at localhost/46459] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 06:03:19,656 INFO [Listener at localhost/46459] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:19,656 INFO [Listener at localhost/46459] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:19,656 INFO [Listener at localhost/46459] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 06:03:19,656 INFO [Listener at localhost/46459] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:19,656 INFO [Listener at localhost/46459] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 06:03:19,656 INFO [Listener at localhost/46459] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 06:03:19,657 INFO [Listener at localhost/46459] ipc.NettyRpcServer(120): Bind to /172.31.14.131:32905 2023-02-12 06:03:19,657 INFO [Listener at localhost/46459] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:19,658 INFO [Listener at localhost/46459] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:19,659 INFO [Listener at localhost/46459] zookeeper.RecoverableZooKeeper(93): Process identifier=master:32905 connecting to ZooKeeper ensemble=127.0.0.1:53582 2023-02-12 06:03:19,666 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:329050x0, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 06:03:19,667 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:32905-0x10047206c980000 connected 2023-02-12 06:03:19,685 DEBUG [Listener at localhost/46459] zookeeper.ZKUtil(164): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 06:03:19,685 DEBUG [Listener at localhost/46459] zookeeper.ZKUtil(164): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:03:19,686 DEBUG [Listener at localhost/46459] zookeeper.ZKUtil(164): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 06:03:19,688 DEBUG [Listener at localhost/46459] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=32905 2023-02-12 06:03:19,688 DEBUG [Listener at localhost/46459] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=32905 2023-02-12 06:03:19,689 DEBUG [Listener at localhost/46459] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=32905 2023-02-12 06:03:19,692 DEBUG [Listener at localhost/46459] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=32905 2023-02-12 06:03:19,694 DEBUG [Listener at localhost/46459] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=32905 2023-02-12 06:03:19,694 INFO [Listener at localhost/46459] master.HMaster(439): hbase.rootdir=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944, hbase.cluster.distributed=false 2023-02-12 06:03:19,707 INFO [Listener at localhost/46459] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 06:03:19,708 INFO [Listener at localhost/46459] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:19,708 INFO [Listener at localhost/46459] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:19,708 INFO [Listener at localhost/46459] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 06:03:19,708 INFO [Listener at localhost/46459] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:19,708 INFO [Listener at localhost/46459] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 06:03:19,708 INFO [Listener at localhost/46459] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 06:03:19,709 INFO [Listener at localhost/46459] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39847 2023-02-12 06:03:19,710 INFO [Listener at localhost/46459] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 06:03:19,713 DEBUG [Listener at localhost/46459] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:03:19,713 INFO [Listener at localhost/46459] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:19,714 INFO [Listener at localhost/46459] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:19,715 INFO [Listener at localhost/46459] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39847 connecting to ZooKeeper ensemble=127.0.0.1:53582 2023-02-12 06:03:19,719 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): regionserver:398470x0, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 06:03:19,720 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:39847-0x10047206c980001 connected 2023-02-12 06:03:19,720 DEBUG [Listener at localhost/46459] zookeeper.ZKUtil(164): regionserver:39847-0x10047206c980001, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 06:03:19,721 DEBUG [Listener at localhost/46459] zookeeper.ZKUtil(164): regionserver:39847-0x10047206c980001, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:03:19,721 DEBUG [Listener at localhost/46459] zookeeper.ZKUtil(164): regionserver:39847-0x10047206c980001, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 06:03:19,722 DEBUG [Listener at localhost/46459] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39847 2023-02-12 06:03:19,722 DEBUG [Listener at localhost/46459] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39847 2023-02-12 06:03:19,722 DEBUG [Listener at localhost/46459] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39847 2023-02-12 06:03:19,725 DEBUG [Listener at localhost/46459] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39847 2023-02-12 06:03:19,726 DEBUG [Listener at localhost/46459] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39847 2023-02-12 06:03:19,737 INFO [Listener at localhost/46459] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 06:03:19,738 INFO [Listener at localhost/46459] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:19,738 INFO [Listener at localhost/46459] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:19,738 INFO [Listener at localhost/46459] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 06:03:19,738 INFO [Listener at localhost/46459] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:19,738 INFO [Listener at localhost/46459] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 06:03:19,738 INFO [Listener at localhost/46459] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 06:03:19,739 INFO [Listener at localhost/46459] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40903 2023-02-12 06:03:19,739 INFO [Listener at localhost/46459] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 06:03:19,740 DEBUG [Listener at localhost/46459] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:03:19,740 INFO [Listener at localhost/46459] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:19,741 INFO [Listener at localhost/46459] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:19,742 INFO [Listener at localhost/46459] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40903 connecting to ZooKeeper ensemble=127.0.0.1:53582 2023-02-12 06:03:19,746 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): regionserver:409030x0, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 06:03:19,748 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40903-0x10047206c980002 connected 2023-02-12 06:03:19,749 DEBUG [Listener at localhost/46459] zookeeper.ZKUtil(164): regionserver:40903-0x10047206c980002, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 06:03:19,749 DEBUG [Listener at localhost/46459] zookeeper.ZKUtil(164): regionserver:40903-0x10047206c980002, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:03:19,750 DEBUG [Listener at localhost/46459] zookeeper.ZKUtil(164): regionserver:40903-0x10047206c980002, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 06:03:19,752 DEBUG [Listener at localhost/46459] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40903 2023-02-12 06:03:19,754 DEBUG [Listener at localhost/46459] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40903 2023-02-12 06:03:19,754 DEBUG [Listener at localhost/46459] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40903 2023-02-12 06:03:19,755 DEBUG [Listener at localhost/46459] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40903 2023-02-12 06:03:19,755 DEBUG [Listener at localhost/46459] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40903 2023-02-12 06:03:19,756 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,32905,1676181799655 2023-02-12 06:03:19,758 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 06:03:19,759 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,32905,1676181799655 2023-02-12 06:03:19,760 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): regionserver:40903-0x10047206c980002, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 06:03:19,760 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 06:03:19,760 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): regionserver:39847-0x10047206c980001, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 06:03:19,761 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:19,762 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 06:03:19,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,32905,1676181799655 from backup master directory 2023-02-12 06:03:19,763 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 06:03:19,764 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,32905,1676181799655 2023-02-12 06:03:19,764 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 06:03:19,764 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 06:03:19,764 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,32905,1676181799655 2023-02-12 06:03:19,776 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/hbase.id with ID: b576faf5-eba0-4ec8-ad02-f96691478ba6 2023-02-12 06:03:19,784 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:19,786 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:19,793 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x5cb841ea to 127.0.0.1:53582 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 06:03:19,799 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22cc7014, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 06:03:19,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 06:03:19,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-12 06:03:19,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 06:03:19,802 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/MasterData/data/master/store-tmp 2023-02-12 06:03:19,811 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:19,811 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 06:03:19,811 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:19,811 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:19,811 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 06:03:19,811 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:19,811 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:19,811 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676181799811Disabling compacts and flushes for region at 1676181799811Disabling writes for close at 1676181799811Writing region close event to WAL at 1676181799811Closed at 1676181799811 2023-02-12 06:03:19,812 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/MasterData/WALs/jenkins-hbase4.apache.org,32905,1676181799655 2023-02-12 06:03:19,814 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C32905%2C1676181799655, suffix=, logDir=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/MasterData/WALs/jenkins-hbase4.apache.org,32905,1676181799655, archiveDir=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/MasterData/oldWALs, maxLogs=10 2023-02-12 06:03:19,829 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39465,DS-05a68eeb-d714-4b9d-865e-ab6ca11e71b4,DISK] 2023-02-12 06:03:19,829 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45349,DS-f25d0f35-74b5-4fbf-a357-17e5e65e49df,DISK] 2023-02-12 06:03:19,831 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/MasterData/WALs/jenkins-hbase4.apache.org,32905,1676181799655/jenkins-hbase4.apache.org%2C32905%2C1676181799655.1676181799814 2023-02-12 06:03:19,831 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39465,DS-05a68eeb-d714-4b9d-865e-ab6ca11e71b4,DISK], DatanodeInfoWithStorage[127.0.0.1:45349,DS-f25d0f35-74b5-4fbf-a357-17e5e65e49df,DISK]] 2023-02-12 06:03:19,831 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-12 06:03:19,831 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:19,831 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:03:19,831 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:03:19,834 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:03:19,835 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-12 06:03:19,835 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-12 06:03:19,836 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:19,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:03:19,837 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:03:19,838 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:03:19,840 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:03:19,840 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68362651, jitterRate=0.01868288218975067}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 06:03:19,840 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676181799831Initializing all the Stores at 1676181799832 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181799832Cleaning up temporary data from old regions at 1676181799837 (+5 ms)Cleaning up detritus from prior splits at 1676181799837Region opened successfully at 1676181799840 (+3 ms) 2023-02-12 06:03:19,842 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-12 06:03:19,843 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-12 06:03:19,844 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-12 06:03:19,844 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-12 06:03:19,844 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-12 06:03:19,844 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-12 06:03:19,844 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-12 06:03:19,845 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-12 06:03:19,846 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-12 06:03:19,856 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-12 06:03:19,856 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-12 06:03:19,857 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-12 06:03:19,857 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-12 06:03:19,857 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-12 06:03:19,859 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:19,859 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-12 06:03:19,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-12 06:03:19,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-12 06:03:19,861 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): regionserver:39847-0x10047206c980001, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 06:03:19,861 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): regionserver:40903-0x10047206c980002, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 06:03:19,861 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 06:03:19,861 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:19,862 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,32905,1676181799655, sessionid=0x10047206c980000, setting cluster-up flag (Was=false) 2023-02-12 06:03:19,867 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:19,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-12 06:03:19,871 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,32905,1676181799655 2023-02-12 06:03:19,874 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:19,879 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-12 06:03:19,879 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,32905,1676181799655 2023-02-12 06:03:19,880 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/.hbase-snapshot/.tmp 2023-02-12 06:03:19,881 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-12 06:03:19,881 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 06:03:19,881 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 06:03:19,881 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 06:03:19,881 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 06:03:19,881 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-12 06:03:19,881 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:19,881 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 06:03:19,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:19,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676181829885 2023-02-12 06:03:19,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-12 06:03:19,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-12 06:03:19,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-12 06:03:19,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-12 06:03:19,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-12 06:03:19,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-12 06:03:19,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:19,885 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 06:03:19,886 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-12 06:03:19,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-12 06:03:19,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-12 06:03:19,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-12 06:03:19,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-12 06:03:19,887 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-12 06:03:19,887 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676181799887,5,FailOnTimeoutGroup] 2023-02-12 06:03:19,887 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676181799887,5,FailOnTimeoutGroup] 2023-02-12 06:03:19,887 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:19,887 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-12 06:03:19,887 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:19,887 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:19,887 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 06:03:19,900 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 06:03:19,901 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 06:03:19,901 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944 2023-02-12 06:03:19,907 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:19,908 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 06:03:19,909 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/hbase/meta/1588230740/info 2023-02-12 06:03:19,909 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 06:03:19,910 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:19,910 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 06:03:19,911 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/hbase/meta/1588230740/rep_barrier 2023-02-12 06:03:19,911 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 06:03:19,911 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:19,911 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 06:03:19,912 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/hbase/meta/1588230740/table 2023-02-12 06:03:19,912 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 06:03:19,913 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:19,913 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/hbase/meta/1588230740 2023-02-12 06:03:19,913 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/hbase/meta/1588230740 2023-02-12 06:03:19,915 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 06:03:19,916 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 06:03:19,917 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:03:19,918 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63542377, jitterRate=-0.053144797682762146}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 06:03:19,918 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676181799907Initializing all the Stores at 1676181799907Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676181799908 (+1 ms)Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181799908Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676181799908Cleaning up temporary data from old regions at 1676181799914 (+6 ms)Cleaning up detritus from prior splits at 1676181799915 (+1 ms)Region opened successfully at 1676181799918 (+3 ms) 2023-02-12 06:03:19,918 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 06:03:19,918 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 06:03:19,918 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 06:03:19,918 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 06:03:19,918 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 06:03:19,918 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 06:03:19,918 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676181799918Disabling compacts and flushes for region at 1676181799918Disabling writes for close at 1676181799918Writing region close event to WAL at 1676181799918Closed at 1676181799918 2023-02-12 06:03:19,919 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 06:03:19,919 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-12 06:03:19,919 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-12 06:03:19,920 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-12 06:03:19,922 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-12 06:03:19,957 INFO [RS:0;jenkins-hbase4:39847] regionserver.HRegionServer(952): ClusterId : b576faf5-eba0-4ec8-ad02-f96691478ba6 2023-02-12 06:03:19,957 INFO [RS:1;jenkins-hbase4:40903] regionserver.HRegionServer(952): ClusterId : b576faf5-eba0-4ec8-ad02-f96691478ba6 2023-02-12 06:03:19,957 DEBUG [RS:0;jenkins-hbase4:39847] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 06:03:19,957 DEBUG [RS:1;jenkins-hbase4:40903] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 06:03:19,959 DEBUG [RS:0;jenkins-hbase4:39847] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 06:03:19,959 DEBUG [RS:1;jenkins-hbase4:40903] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 06:03:19,959 DEBUG [RS:0;jenkins-hbase4:39847] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 06:03:19,959 DEBUG [RS:1;jenkins-hbase4:40903] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 06:03:19,961 DEBUG [RS:0;jenkins-hbase4:39847] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 06:03:19,961 DEBUG [RS:1;jenkins-hbase4:40903] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 06:03:19,963 DEBUG [RS:0;jenkins-hbase4:39847] zookeeper.ReadOnlyZKClient(139): Connect 0x73124062 to 127.0.0.1:53582 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 06:03:19,963 DEBUG [RS:1;jenkins-hbase4:40903] zookeeper.ReadOnlyZKClient(139): Connect 0x0b21bfb0 to 127.0.0.1:53582 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 06:03:19,976 DEBUG [RS:0;jenkins-hbase4:39847] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7dd5a070, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 06:03:19,976 DEBUG [RS:1;jenkins-hbase4:40903] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e650a4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 06:03:19,976 DEBUG [RS:0;jenkins-hbase4:39847] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79ea2b12, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 06:03:19,976 DEBUG [RS:1;jenkins-hbase4:40903] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d9d4c0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 06:03:19,985 DEBUG [RS:0;jenkins-hbase4:39847] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:39847 2023-02-12 06:03:19,985 DEBUG [RS:1;jenkins-hbase4:40903] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:40903 2023-02-12 06:03:19,985 INFO [RS:0;jenkins-hbase4:39847] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 06:03:19,985 INFO [RS:0;jenkins-hbase4:39847] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 06:03:19,985 INFO [RS:1;jenkins-hbase4:40903] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 06:03:19,986 DEBUG [RS:0;jenkins-hbase4:39847] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 06:03:19,986 INFO [RS:1;jenkins-hbase4:40903] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 06:03:19,986 DEBUG [RS:1;jenkins-hbase4:40903] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 06:03:19,986 INFO [RS:0;jenkins-hbase4:39847] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,32905,1676181799655 with isa=jenkins-hbase4.apache.org/172.31.14.131:39847, startcode=1676181799707 2023-02-12 06:03:19,986 INFO [RS:1;jenkins-hbase4:40903] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,32905,1676181799655 with isa=jenkins-hbase4.apache.org/172.31.14.131:40903, startcode=1676181799737 2023-02-12 06:03:19,986 DEBUG [RS:0;jenkins-hbase4:39847] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 06:03:19,986 DEBUG [RS:1;jenkins-hbase4:40903] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 06:03:19,988 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47827, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 06:03:19,988 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38279, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 06:03:19,990 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32905] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:19,990 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39847,1676181799707 2023-02-12 06:03:19,991 DEBUG [RS:1;jenkins-hbase4:40903] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944 2023-02-12 06:03:19,991 DEBUG [RS:0;jenkins-hbase4:39847] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944 2023-02-12 06:03:19,991 DEBUG [RS:0;jenkins-hbase4:39847] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:35673 2023-02-12 06:03:19,991 DEBUG [RS:0;jenkins-hbase4:39847] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 06:03:19,991 DEBUG [RS:1;jenkins-hbase4:40903] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:35673 2023-02-12 06:03:19,991 DEBUG [RS:1;jenkins-hbase4:40903] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 06:03:19,993 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 06:03:19,996 DEBUG [RS:0;jenkins-hbase4:39847] zookeeper.ZKUtil(162): regionserver:39847-0x10047206c980001, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39847,1676181799707 2023-02-12 06:03:19,996 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39847,1676181799707] 2023-02-12 06:03:19,996 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40903,1676181799737] 2023-02-12 06:03:19,996 WARN [RS:0;jenkins-hbase4:39847] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 06:03:19,996 DEBUG [RS:1;jenkins-hbase4:40903] zookeeper.ZKUtil(162): regionserver:40903-0x10047206c980002, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:19,996 INFO [RS:0;jenkins-hbase4:39847] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 06:03:19,996 WARN [RS:1;jenkins-hbase4:40903] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 06:03:19,996 DEBUG [RS:0;jenkins-hbase4:39847] regionserver.HRegionServer(1947): logDir=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/WALs/jenkins-hbase4.apache.org,39847,1676181799707 2023-02-12 06:03:19,996 INFO [RS:1;jenkins-hbase4:40903] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 06:03:19,996 DEBUG [RS:1;jenkins-hbase4:40903] regionserver.HRegionServer(1947): logDir=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/WALs/jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:20,004 DEBUG [RS:1;jenkins-hbase4:40903] zookeeper.ZKUtil(162): regionserver:40903-0x10047206c980002, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:20,004 DEBUG [RS:0;jenkins-hbase4:39847] zookeeper.ZKUtil(162): regionserver:39847-0x10047206c980001, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:20,005 DEBUG [RS:1;jenkins-hbase4:40903] zookeeper.ZKUtil(162): regionserver:40903-0x10047206c980002, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39847,1676181799707 2023-02-12 06:03:20,005 DEBUG [RS:0;jenkins-hbase4:39847] zookeeper.ZKUtil(162): regionserver:39847-0x10047206c980001, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39847,1676181799707 2023-02-12 06:03:20,005 DEBUG [RS:1;jenkins-hbase4:40903] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 06:03:20,005 DEBUG [RS:0;jenkins-hbase4:39847] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 06:03:20,005 INFO [RS:1;jenkins-hbase4:40903] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 06:03:20,006 INFO [RS:0;jenkins-hbase4:39847] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 06:03:20,007 INFO [RS:1;jenkins-hbase4:40903] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 06:03:20,007 INFO [RS:1;jenkins-hbase4:40903] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 06:03:20,007 INFO [RS:1;jenkins-hbase4:40903] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:20,008 INFO [RS:1;jenkins-hbase4:40903] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 06:03:20,013 INFO [RS:0;jenkins-hbase4:39847] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 06:03:20,013 INFO [RS:0;jenkins-hbase4:39847] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 06:03:20,013 INFO [RS:0;jenkins-hbase4:39847] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:20,013 INFO [RS:0;jenkins-hbase4:39847] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 06:03:20,013 INFO [RS:1;jenkins-hbase4:40903] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:20,014 DEBUG [RS:1;jenkins-hbase4:40903] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:20,015 DEBUG [RS:1;jenkins-hbase4:40903] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:20,015 DEBUG [RS:1;jenkins-hbase4:40903] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:20,015 DEBUG [RS:1;jenkins-hbase4:40903] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:20,015 DEBUG [RS:1;jenkins-hbase4:40903] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:20,015 INFO [RS:0;jenkins-hbase4:39847] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:20,015 DEBUG [RS:1;jenkins-hbase4:40903] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 06:03:20,015 DEBUG [RS:0;jenkins-hbase4:39847] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:20,015 DEBUG [RS:0;jenkins-hbase4:39847] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:20,015 DEBUG [RS:1;jenkins-hbase4:40903] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:20,015 DEBUG [RS:0;jenkins-hbase4:39847] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:20,015 DEBUG [RS:1;jenkins-hbase4:40903] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:20,015 DEBUG [RS:0;jenkins-hbase4:39847] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:20,015 DEBUG [RS:1;jenkins-hbase4:40903] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:20,015 DEBUG [RS:0;jenkins-hbase4:39847] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:20,015 DEBUG [RS:1;jenkins-hbase4:40903] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:20,015 DEBUG [RS:0;jenkins-hbase4:39847] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 06:03:20,015 DEBUG [RS:0;jenkins-hbase4:39847] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:20,015 DEBUG [RS:0;jenkins-hbase4:39847] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:20,015 DEBUG [RS:0;jenkins-hbase4:39847] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:20,015 DEBUG [RS:0;jenkins-hbase4:39847] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:20,020 INFO [RS:1;jenkins-hbase4:40903] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:20,020 INFO [RS:1;jenkins-hbase4:40903] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:20,020 INFO [RS:1;jenkins-hbase4:40903] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:20,020 INFO [RS:0;jenkins-hbase4:39847] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:20,020 INFO [RS:0;jenkins-hbase4:39847] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:20,020 INFO [RS:0;jenkins-hbase4:39847] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:20,032 INFO [RS:1;jenkins-hbase4:40903] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 06:03:20,032 INFO [RS:0;jenkins-hbase4:39847] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 06:03:20,032 INFO [RS:1;jenkins-hbase4:40903] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40903,1676181799737-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:20,032 INFO [RS:0;jenkins-hbase4:39847] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39847,1676181799707-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:20,044 INFO [RS:1;jenkins-hbase4:40903] regionserver.Replication(203): jenkins-hbase4.apache.org,40903,1676181799737 started 2023-02-12 06:03:20,044 INFO [RS:1;jenkins-hbase4:40903] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,40903,1676181799737, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40903, sessionid=0x10047206c980002 2023-02-12 06:03:20,044 DEBUG [RS:1;jenkins-hbase4:40903] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 06:03:20,044 DEBUG [RS:1;jenkins-hbase4:40903] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:20,044 DEBUG [RS:1;jenkins-hbase4:40903] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40903,1676181799737' 2023-02-12 06:03:20,044 DEBUG [RS:1;jenkins-hbase4:40903] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:03:20,045 DEBUG [RS:1;jenkins-hbase4:40903] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:03:20,045 DEBUG [RS:1;jenkins-hbase4:40903] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 06:03:20,045 DEBUG [RS:1;jenkins-hbase4:40903] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 06:03:20,045 DEBUG [RS:1;jenkins-hbase4:40903] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:20,045 DEBUG [RS:1;jenkins-hbase4:40903] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40903,1676181799737' 2023-02-12 06:03:20,045 DEBUG [RS:1;jenkins-hbase4:40903] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:03:20,045 DEBUG [RS:1;jenkins-hbase4:40903] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:03:20,046 DEBUG [RS:1;jenkins-hbase4:40903] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 06:03:20,046 INFO [RS:1;jenkins-hbase4:40903] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 06:03:20,046 INFO [RS:1;jenkins-hbase4:40903] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 06:03:20,049 INFO [RS:0;jenkins-hbase4:39847] regionserver.Replication(203): jenkins-hbase4.apache.org,39847,1676181799707 started 2023-02-12 06:03:20,049 INFO [RS:0;jenkins-hbase4:39847] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,39847,1676181799707, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39847, sessionid=0x10047206c980001 2023-02-12 06:03:20,049 DEBUG [RS:0;jenkins-hbase4:39847] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 06:03:20,049 DEBUG [RS:0;jenkins-hbase4:39847] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39847,1676181799707 2023-02-12 06:03:20,049 DEBUG [RS:0;jenkins-hbase4:39847] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39847,1676181799707' 2023-02-12 06:03:20,050 DEBUG [RS:0;jenkins-hbase4:39847] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:03:20,050 DEBUG [RS:0;jenkins-hbase4:39847] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:03:20,050 DEBUG [RS:0;jenkins-hbase4:39847] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 06:03:20,050 DEBUG [RS:0;jenkins-hbase4:39847] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 06:03:20,050 DEBUG [RS:0;jenkins-hbase4:39847] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39847,1676181799707 2023-02-12 06:03:20,050 DEBUG [RS:0;jenkins-hbase4:39847] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39847,1676181799707' 2023-02-12 06:03:20,050 DEBUG [RS:0;jenkins-hbase4:39847] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:03:20,051 DEBUG [RS:0;jenkins-hbase4:39847] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:03:20,051 DEBUG [RS:0;jenkins-hbase4:39847] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 06:03:20,051 INFO [RS:0;jenkins-hbase4:39847] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 06:03:20,051 INFO [RS:0;jenkins-hbase4:39847] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 06:03:20,072 DEBUG [jenkins-hbase4:32905] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-12 06:03:20,072 DEBUG [jenkins-hbase4:32905] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 06:03:20,074 DEBUG [jenkins-hbase4:32905] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 06:03:20,074 DEBUG [jenkins-hbase4:32905] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 06:03:20,074 DEBUG [jenkins-hbase4:32905] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 06:03:20,074 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40903,1676181799737, state=OPENING 2023-02-12 06:03:20,078 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-12 06:03:20,082 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:20,085 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 06:03:20,085 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40903,1676181799737}] 2023-02-12 06:03:20,239 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:20,239 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 06:03:20,240 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52720, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 06:03:20,245 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-12 06:03:20,245 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 06:03:20,246 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40903%2C1676181799737.meta, suffix=.meta, logDir=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/WALs/jenkins-hbase4.apache.org,40903,1676181799737, archiveDir=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/oldWALs, maxLogs=32 2023-02-12 06:03:20,259 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39465,DS-05a68eeb-d714-4b9d-865e-ab6ca11e71b4,DISK] 2023-02-12 06:03:20,259 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45349,DS-f25d0f35-74b5-4fbf-a357-17e5e65e49df,DISK] 2023-02-12 06:03:20,261 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/WALs/jenkins-hbase4.apache.org,40903,1676181799737/jenkins-hbase4.apache.org%2C40903%2C1676181799737.meta.1676181800246.meta 2023-02-12 06:03:20,261 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45349,DS-f25d0f35-74b5-4fbf-a357-17e5e65e49df,DISK], DatanodeInfoWithStorage[127.0.0.1:39465,DS-05a68eeb-d714-4b9d-865e-ab6ca11e71b4,DISK]] 2023-02-12 06:03:20,261 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-12 06:03:20,261 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-12 06:03:20,262 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-12 06:03:20,262 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-12 06:03:20,262 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-12 06:03:20,262 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:20,262 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-12 06:03:20,262 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-12 06:03:20,263 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 06:03:20,264 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/hbase/meta/1588230740/info 2023-02-12 06:03:20,264 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/hbase/meta/1588230740/info 2023-02-12 06:03:20,264 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 06:03:20,264 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:20,265 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 06:03:20,265 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/hbase/meta/1588230740/rep_barrier 2023-02-12 06:03:20,265 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/hbase/meta/1588230740/rep_barrier 2023-02-12 06:03:20,265 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 06:03:20,266 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:20,266 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 06:03:20,267 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/hbase/meta/1588230740/table 2023-02-12 06:03:20,267 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/hbase/meta/1588230740/table 2023-02-12 06:03:20,267 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 06:03:20,267 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:20,268 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/hbase/meta/1588230740 2023-02-12 06:03:20,268 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/hbase/meta/1588230740 2023-02-12 06:03:20,270 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 06:03:20,271 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 06:03:20,272 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61817201, jitterRate=-0.07885192334651947}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 06:03:20,272 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676181800262Writing region info on filesystem at 1676181800262Initializing all the Stores at 1676181800263 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676181800263Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181800263Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676181800263Cleaning up temporary data from old regions at 1676181800269 (+6 ms)Cleaning up detritus from prior splits at 1676181800269Running coprocessor post-open hooks at 1676181800272 (+3 ms)Region opened successfully at 1676181800272 2023-02-12 06:03:20,272 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676181800239 2023-02-12 06:03:20,276 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-12 06:03:20,276 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-12 06:03:20,278 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40903,1676181799737, state=OPEN 2023-02-12 06:03:20,279 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-12 06:03:20,279 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 06:03:20,281 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-12 06:03:20,281 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40903,1676181799737 in 196 msec 2023-02-12 06:03:20,282 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-12 06:03:20,282 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 362 msec 2023-02-12 06:03:20,284 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 403 msec 2023-02-12 06:03:20,284 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676181799759, completionTime=-1 2023-02-12 06:03:20,284 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-12 06:03:20,284 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-12 06:03:20,287 DEBUG [hconnection-0x2938ad05-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 06:03:20,288 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52730, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 06:03:20,289 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-12 06:03:20,289 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676181860289 2023-02-12 06:03:20,289 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676181920289 2023-02-12 06:03:20,289 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-12 06:03:20,297 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32905,1676181799655-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:20,297 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32905,1676181799655-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:20,297 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32905,1676181799655-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:20,298 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:32905, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:20,298 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:20,298 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-12 06:03:20,298 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 06:03:20,299 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-12 06:03:20,300 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-12 06:03:20,300 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 06:03:20,300 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 06:03:20,302 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/.tmp/data/hbase/namespace/7befabc880c6bfc62f9f759f3569e505 2023-02-12 06:03:20,302 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/.tmp/data/hbase/namespace/7befabc880c6bfc62f9f759f3569e505 empty. 2023-02-12 06:03:20,302 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/.tmp/data/hbase/namespace/7befabc880c6bfc62f9f759f3569e505 2023-02-12 06:03:20,302 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-12 06:03:20,311 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-12 06:03:20,312 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7befabc880c6bfc62f9f759f3569e505, NAME => 'hbase:namespace,,1676181800298.7befabc880c6bfc62f9f759f3569e505.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/.tmp 2023-02-12 06:03:20,318 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676181800298.7befabc880c6bfc62f9f759f3569e505.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:20,319 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 7befabc880c6bfc62f9f759f3569e505, disabling compactions & flushes 2023-02-12 06:03:20,319 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676181800298.7befabc880c6bfc62f9f759f3569e505. 2023-02-12 06:03:20,319 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676181800298.7befabc880c6bfc62f9f759f3569e505. 2023-02-12 06:03:20,319 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676181800298.7befabc880c6bfc62f9f759f3569e505. after waiting 0 ms 2023-02-12 06:03:20,319 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676181800298.7befabc880c6bfc62f9f759f3569e505. 2023-02-12 06:03:20,319 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676181800298.7befabc880c6bfc62f9f759f3569e505. 2023-02-12 06:03:20,319 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 7befabc880c6bfc62f9f759f3569e505: Waiting for close lock at 1676181800319Disabling compacts and flushes for region at 1676181800319Disabling writes for close at 1676181800319Writing region close event to WAL at 1676181800319Closed at 1676181800319 2023-02-12 06:03:20,321 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 06:03:20,322 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676181800298.7befabc880c6bfc62f9f759f3569e505.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676181800321"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181800321"}]},"ts":"1676181800321"} 2023-02-12 06:03:20,324 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 06:03:20,325 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 06:03:20,325 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676181800325"}]},"ts":"1676181800325"} 2023-02-12 06:03:20,326 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-12 06:03:20,330 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 06:03:20,330 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 06:03:20,330 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 06:03:20,330 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 06:03:20,331 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7befabc880c6bfc62f9f759f3569e505, ASSIGN}] 2023-02-12 06:03:20,333 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7befabc880c6bfc62f9f759f3569e505, ASSIGN 2023-02-12 06:03:20,334 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=7befabc880c6bfc62f9f759f3569e505, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40903,1676181799737; forceNewPlan=false, retain=false 2023-02-12 06:03:20,484 INFO [jenkins-hbase4:32905] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 06:03:20,484 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7befabc880c6bfc62f9f759f3569e505, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:20,484 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676181800298.7befabc880c6bfc62f9f759f3569e505.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676181800484"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181800484"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181800484"}]},"ts":"1676181800484"} 2023-02-12 06:03:20,486 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 7befabc880c6bfc62f9f759f3569e505, server=jenkins-hbase4.apache.org,40903,1676181799737}] 2023-02-12 06:03:20,641 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676181800298.7befabc880c6bfc62f9f759f3569e505. 2023-02-12 06:03:20,643 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40903%2C1676181799737, suffix=, logDir=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/WALs/jenkins-hbase4.apache.org,40903,1676181799737, archiveDir=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/oldWALs, maxLogs=32 2023-02-12 06:03:20,656 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39465,DS-05a68eeb-d714-4b9d-865e-ab6ca11e71b4,DISK] 2023-02-12 06:03:20,656 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45349,DS-f25d0f35-74b5-4fbf-a357-17e5e65e49df,DISK] 2023-02-12 06:03:20,658 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/WALs/jenkins-hbase4.apache.org,40903,1676181799737/jenkins-hbase4.apache.org%2C40903%2C1676181799737.1676181800643 2023-02-12 06:03:20,658 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39465,DS-05a68eeb-d714-4b9d-865e-ab6ca11e71b4,DISK], DatanodeInfoWithStorage[127.0.0.1:45349,DS-f25d0f35-74b5-4fbf-a357-17e5e65e49df,DISK]] 2023-02-12 06:03:20,658 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7befabc880c6bfc62f9f759f3569e505, NAME => 'hbase:namespace,,1676181800298.7befabc880c6bfc62f9f759f3569e505.', STARTKEY => '', ENDKEY => ''} 2023-02-12 06:03:20,659 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 7befabc880c6bfc62f9f759f3569e505 2023-02-12 06:03:20,659 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676181800298.7befabc880c6bfc62f9f759f3569e505.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:20,659 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7befabc880c6bfc62f9f759f3569e505 2023-02-12 06:03:20,659 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7befabc880c6bfc62f9f759f3569e505 2023-02-12 06:03:20,660 INFO [StoreOpener-7befabc880c6bfc62f9f759f3569e505-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 7befabc880c6bfc62f9f759f3569e505 2023-02-12 06:03:20,661 DEBUG [StoreOpener-7befabc880c6bfc62f9f759f3569e505-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/hbase/namespace/7befabc880c6bfc62f9f759f3569e505/info 2023-02-12 06:03:20,661 DEBUG [StoreOpener-7befabc880c6bfc62f9f759f3569e505-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/hbase/namespace/7befabc880c6bfc62f9f759f3569e505/info 2023-02-12 06:03:20,662 INFO [StoreOpener-7befabc880c6bfc62f9f759f3569e505-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7befabc880c6bfc62f9f759f3569e505 columnFamilyName info 2023-02-12 06:03:20,662 INFO [StoreOpener-7befabc880c6bfc62f9f759f3569e505-1] regionserver.HStore(310): Store=7befabc880c6bfc62f9f759f3569e505/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:20,663 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/hbase/namespace/7befabc880c6bfc62f9f759f3569e505 2023-02-12 06:03:20,663 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/hbase/namespace/7befabc880c6bfc62f9f759f3569e505 2023-02-12 06:03:20,665 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7befabc880c6bfc62f9f759f3569e505 2023-02-12 06:03:20,667 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/hbase/namespace/7befabc880c6bfc62f9f759f3569e505/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:03:20,667 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7befabc880c6bfc62f9f759f3569e505; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64145282, jitterRate=-0.044160813093185425}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 06:03:20,667 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7befabc880c6bfc62f9f759f3569e505: Running coprocessor pre-open hook at 1676181800659Writing region info on filesystem at 1676181800659Initializing all the Stores at 1676181800660 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676181800660Cleaning up temporary data from old regions at 1676181800663 (+3 ms)Cleaning up detritus from prior splits at 1676181800664 (+1 ms)Running coprocessor post-open hooks at 1676181800667 (+3 ms)Region opened successfully at 1676181800667 2023-02-12 06:03:20,668 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676181800298.7befabc880c6bfc62f9f759f3569e505., pid=6, masterSystemTime=1676181800638 2023-02-12 06:03:20,671 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676181800298.7befabc880c6bfc62f9f759f3569e505. 2023-02-12 06:03:20,671 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676181800298.7befabc880c6bfc62f9f759f3569e505. 2023-02-12 06:03:20,671 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7befabc880c6bfc62f9f759f3569e505, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:20,671 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676181800298.7befabc880c6bfc62f9f759f3569e505.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676181800671"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676181800671"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676181800671"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676181800671"}]},"ts":"1676181800671"} 2023-02-12 06:03:20,674 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-12 06:03:20,674 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 7befabc880c6bfc62f9f759f3569e505, server=jenkins-hbase4.apache.org,40903,1676181799737 in 187 msec 2023-02-12 06:03:20,676 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-12 06:03:20,676 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=7befabc880c6bfc62f9f759f3569e505, ASSIGN in 343 msec 2023-02-12 06:03:20,676 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 06:03:20,676 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676181800676"}]},"ts":"1676181800676"} 2023-02-12 06:03:20,677 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-12 06:03:20,679 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 06:03:20,680 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 381 msec 2023-02-12 06:03:20,700 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-12 06:03:20,702 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-12 06:03:20,702 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:20,705 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-12 06:03:20,712 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 06:03:20,715 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-12 06:03:20,717 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-12 06:03:20,723 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 06:03:20,727 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 10 msec 2023-02-12 06:03:20,741 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-12 06:03:20,744 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-12 06:03:20,744 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.980sec 2023-02-12 06:03:20,744 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-12 06:03:20,744 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-12 06:03:20,744 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-12 06:03:20,744 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32905,1676181799655-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-12 06:03:20,744 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32905,1676181799655-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-12 06:03:20,745 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-12 06:03:20,757 DEBUG [Listener at localhost/46459] zookeeper.ReadOnlyZKClient(139): Connect 0x1e1c7ce1 to 127.0.0.1:53582 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 06:03:20,764 DEBUG [Listener at localhost/46459] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@381989ea, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 06:03:20,765 DEBUG [hconnection-0x4b52d97a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 06:03:20,767 INFO [RS-EventLoopGroup-17-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52732, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 06:03:20,768 INFO [Listener at localhost/46459] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,32905,1676181799655 2023-02-12 06:03:20,768 DEBUG [Listener at localhost/46459] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-12 06:03:20,770 DEBUG [Listener at localhost/46459] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 06:03:20,772 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60192, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 06:03:20,772 INFO [Listener at localhost/46459] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-12 06:03:20,773 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-12 06:03:20,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-12 06:03:20,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 94 connection: 172.31.14.131:60192 deadline: 1676181860773, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-12 06:03:20,773 INFO [Listener at localhost/46459] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-12 06:03:20,776 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 06:03:20,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-12 06:03:20,778 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 06:03:20,778 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-12 06:03:20,779 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 06:03:20,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 06:03:20,780 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/.tmp/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa 2023-02-12 06:03:20,781 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/.tmp/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa empty. 2023-02-12 06:03:20,781 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/.tmp/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa 2023-02-12 06:03:20,781 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-12 06:03:20,789 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-12 06:03:20,790 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => bcf2f6cd7aa91a19057352b677a2b5fa, NAME => 'testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/.tmp 2023-02-12 06:03:20,796 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:20,796 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing bcf2f6cd7aa91a19057352b677a2b5fa, disabling compactions & flushes 2023-02-12 06:03:20,796 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa. 2023-02-12 06:03:20,796 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa. 2023-02-12 06:03:20,797 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa. after waiting 0 ms 2023-02-12 06:03:20,797 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa. 2023-02-12 06:03:20,797 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa. 2023-02-12 06:03:20,797 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for bcf2f6cd7aa91a19057352b677a2b5fa: Waiting for close lock at 1676181800796Disabling compacts and flushes for region at 1676181800796Disabling writes for close at 1676181800797 (+1 ms)Writing region close event to WAL at 1676181800797Closed at 1676181800797 2023-02-12 06:03:20,798 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 06:03:20,799 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676181800799"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181800799"}]},"ts":"1676181800799"} 2023-02-12 06:03:20,800 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 06:03:20,801 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 06:03:20,801 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676181800801"}]},"ts":"1676181800801"} 2023-02-12 06:03:20,802 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-12 06:03:20,805 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 06:03:20,806 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 06:03:20,806 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 06:03:20,806 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 06:03:20,806 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=bcf2f6cd7aa91a19057352b677a2b5fa, ASSIGN}] 2023-02-12 06:03:20,808 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=bcf2f6cd7aa91a19057352b677a2b5fa, ASSIGN 2023-02-12 06:03:20,808 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=bcf2f6cd7aa91a19057352b677a2b5fa, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40903,1676181799737; forceNewPlan=false, retain=false 2023-02-12 06:03:20,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 06:03:20,958 INFO [jenkins-hbase4:32905] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 06:03:20,959 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=bcf2f6cd7aa91a19057352b677a2b5fa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:20,959 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676181800959"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181800959"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181800959"}]},"ts":"1676181800959"} 2023-02-12 06:03:20,961 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure bcf2f6cd7aa91a19057352b677a2b5fa, server=jenkins-hbase4.apache.org,40903,1676181799737}] 2023-02-12 06:03:21,053 INFO [RS:0;jenkins-hbase4:39847] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39847%2C1676181799707, suffix=, logDir=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/WALs/jenkins-hbase4.apache.org,39847,1676181799707, archiveDir=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/oldWALs, maxLogs=32 2023-02-12 06:03:21,070 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45349,DS-f25d0f35-74b5-4fbf-a357-17e5e65e49df,DISK] 2023-02-12 06:03:21,070 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39465,DS-05a68eeb-d714-4b9d-865e-ab6ca11e71b4,DISK] 2023-02-12 06:03:21,071 INFO [RS:0;jenkins-hbase4:39847] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/WALs/jenkins-hbase4.apache.org,39847,1676181799707/jenkins-hbase4.apache.org%2C39847%2C1676181799707.1676181801053 2023-02-12 06:03:21,072 DEBUG [RS:0;jenkins-hbase4:39847] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39465,DS-05a68eeb-d714-4b9d-865e-ab6ca11e71b4,DISK], DatanodeInfoWithStorage[127.0.0.1:45349,DS-f25d0f35-74b5-4fbf-a357-17e5e65e49df,DISK]] 2023-02-12 06:03:21,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 06:03:21,115 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa. 2023-02-12 06:03:21,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => bcf2f6cd7aa91a19057352b677a2b5fa, NAME => 'testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa.', STARTKEY => '', ENDKEY => ''} 2023-02-12 06:03:21,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion bcf2f6cd7aa91a19057352b677a2b5fa 2023-02-12 06:03:21,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:21,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for bcf2f6cd7aa91a19057352b677a2b5fa 2023-02-12 06:03:21,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for bcf2f6cd7aa91a19057352b677a2b5fa 2023-02-12 06:03:21,117 INFO [StoreOpener-bcf2f6cd7aa91a19057352b677a2b5fa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bcf2f6cd7aa91a19057352b677a2b5fa 2023-02-12 06:03:21,118 DEBUG [StoreOpener-bcf2f6cd7aa91a19057352b677a2b5fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/f1 2023-02-12 06:03:21,118 DEBUG [StoreOpener-bcf2f6cd7aa91a19057352b677a2b5fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/f1 2023-02-12 06:03:21,118 INFO [StoreOpener-bcf2f6cd7aa91a19057352b677a2b5fa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bcf2f6cd7aa91a19057352b677a2b5fa columnFamilyName f1 2023-02-12 06:03:21,119 INFO [StoreOpener-bcf2f6cd7aa91a19057352b677a2b5fa-1] regionserver.HStore(310): Store=bcf2f6cd7aa91a19057352b677a2b5fa/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:21,119 INFO [StoreOpener-bcf2f6cd7aa91a19057352b677a2b5fa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bcf2f6cd7aa91a19057352b677a2b5fa 2023-02-12 06:03:21,120 DEBUG [StoreOpener-bcf2f6cd7aa91a19057352b677a2b5fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/f2 2023-02-12 06:03:21,120 DEBUG [StoreOpener-bcf2f6cd7aa91a19057352b677a2b5fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/f2 2023-02-12 06:03:21,120 INFO [StoreOpener-bcf2f6cd7aa91a19057352b677a2b5fa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bcf2f6cd7aa91a19057352b677a2b5fa columnFamilyName f2 2023-02-12 06:03:21,121 INFO [StoreOpener-bcf2f6cd7aa91a19057352b677a2b5fa-1] regionserver.HStore(310): Store=bcf2f6cd7aa91a19057352b677a2b5fa/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:21,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa 2023-02-12 06:03:21,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa 2023-02-12 06:03:21,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:03:21,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for bcf2f6cd7aa91a19057352b677a2b5fa 2023-02-12 06:03:21,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:03:21,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened bcf2f6cd7aa91a19057352b677a2b5fa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64316960, jitterRate=-0.04160261154174805}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:03:21,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for bcf2f6cd7aa91a19057352b677a2b5fa: Running coprocessor pre-open hook at 1676181801116Writing region info on filesystem at 1676181801116Initializing all the Stores at 1676181801116Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181801116Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181801117 (+1 ms)Cleaning up temporary data from old regions at 1676181801123 (+6 ms)Cleaning up detritus from prior splits at 1676181801123Running coprocessor post-open hooks at 1676181801126 (+3 ms)Region opened successfully at 1676181801126 2023-02-12 06:03:21,127 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa., pid=12, masterSystemTime=1676181801112 2023-02-12 06:03:21,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa. 2023-02-12 06:03:21,128 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa. 2023-02-12 06:03:21,129 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=bcf2f6cd7aa91a19057352b677a2b5fa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:21,129 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676181801129"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676181801129"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676181801129"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676181801129"}]},"ts":"1676181801129"} 2023-02-12 06:03:21,131 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-12 06:03:21,132 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure bcf2f6cd7aa91a19057352b677a2b5fa, server=jenkins-hbase4.apache.org,40903,1676181799737 in 169 msec 2023-02-12 06:03:21,133 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-12 06:03:21,133 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=bcf2f6cd7aa91a19057352b677a2b5fa, ASSIGN in 326 msec 2023-02-12 06:03:21,133 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 06:03:21,133 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676181801133"}]},"ts":"1676181801133"} 2023-02-12 06:03:21,134 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-12 06:03:21,137 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 06:03:21,138 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 361 msec 2023-02-12 06:03:21,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 06:03:21,385 INFO [Listener at localhost/46459] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-12 06:03:21,385 DEBUG [Listener at localhost/46459] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-12 06:03:21,386 INFO [Listener at localhost/46459] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 06:03:21,389 INFO [Listener at localhost/46459] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-12 06:03:21,389 INFO [Listener at localhost/46459] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 06:03:21,390 INFO [Listener at localhost/46459] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-12 06:03:21,390 INFO [Listener at localhost/46459] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-12 06:03:21,427 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40903] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa. 2023-02-12 06:03:21,539 INFO [Listener at localhost/46459] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-12 06:03:21,539 INFO [Listener at localhost/46459] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-12 06:03:21,541 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-12 06:03:21,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676181801541 (current time:1676181801541). 2023-02-12 06:03:21,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-12 06:03:21,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] zookeeper.ReadOnlyZKClient(139): Connect 0x37329eaf to 127.0.0.1:53582 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 06:03:21,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1417c1dc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 06:03:21,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 06:03:21,553 INFO [RS-EventLoopGroup-17-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52734, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 06:03:21,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37329eaf to 127.0.0.1:53582 2023-02-12 06:03:21,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:21,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-12 06:03:21,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-12 06:03:21,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-12 06:03:21,558 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-12 06:03:21,558 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676182401558 2023-02-12 06:03:21,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-12 06:03:21,559 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,560 DEBUG [Listener at localhost/46459] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-12 06:03:21,560 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-12 06:03:21,561 DEBUG [Listener at localhost/46459] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-12 06:03:21,561 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-12 06:03:21,561 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 5 msec 2023-02-12 06:03:21,562 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-12 06:03:21,562 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1676182401562 2023-02-12 06:03:21,580 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,581 INFO [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-12 06:03:21,581 DEBUG [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 06:03:21,582 DEBUG [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-12 06:03:21,582 DEBUG [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-12 06:03:21,582 DEBUG [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,582 DEBUG [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,584 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): regionserver:40903-0x10047206c980002, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 06:03:21,584 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): regionserver:39847-0x10047206c980001, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 06:03:21,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 06:03:21,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 06:03:21,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:03:21,584 DEBUG [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:21,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:03:21,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,585 DEBUG [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:21,585 DEBUG [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 06:03:21,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,585 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39847-0x10047206c980001, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,585 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40903-0x10047206c980002, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-12 06:03:21,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-12 06:03:21,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,585 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-12 06:03:21,586 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-12 06:03:21,586 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,588 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,588 DEBUG [member: 'jenkins-hbase4.apache.org,40903,1676181799737' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-12 06:03:21,588 DEBUG [member: 'jenkins-hbase4.apache.org,40903,1676181799737' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 06:03:21,588 DEBUG [member: 'jenkins-hbase4.apache.org,39847,1676181799707' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-12 06:03:21,589 DEBUG [member: 'jenkins-hbase4.apache.org,40903,1676181799737' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-12 06:03:21,589 DEBUG [member: 'jenkins-hbase4.apache.org,40903,1676181799737' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-12 06:03:21,589 DEBUG [member: 'jenkins-hbase4.apache.org,40903,1676181799737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40903,1676181799737' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-12 06:03:21,589 DEBUG [member: 'jenkins-hbase4.apache.org,39847,1676181799707' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 06:03:21,590 DEBUG [member: 'jenkins-hbase4.apache.org,39847,1676181799707' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-12 06:03:21,590 DEBUG [member: 'jenkins-hbase4.apache.org,39847,1676181799707' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-12 06:03:21,590 DEBUG [member: 'jenkins-hbase4.apache.org,39847,1676181799707' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39847,1676181799707' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-12 06:03:21,592 DEBUG [member: 'jenkins-hbase4.apache.org,40903,1676181799737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,592 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:21,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:21,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:21,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 06:03:21,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:21,593 DEBUG [member: 'jenkins-hbase4.apache.org,40903,1676181799737' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40903-0x10047206c980002, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,593 DEBUG [member: 'jenkins-hbase4.apache.org,40903,1676181799737' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 06:03:21,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:21,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,600 DEBUG [member: 'jenkins-hbase4.apache.org,39847,1676181799707' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:21,604 DEBUG [member: 'jenkins-hbase4.apache.org,39847,1676181799707' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39847-0x10047206c980001, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,604 DEBUG [member: 'jenkins-hbase4.apache.org,39847,1676181799707' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 06:03:21,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39847,1676181799707 2023-02-12 06:03:21,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:21,605 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40903,1676181799737' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-12 06:03:21,605 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40db1384[Count = 0] remaining members to acquire global barrier 2023-02-12 06:03:21,605 DEBUG [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-12 06:03:21,605 DEBUG [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,606 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): regionserver:40903-0x10047206c980002, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,606 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): regionserver:39847-0x10047206c980001, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,606 DEBUG [member: 'jenkins-hbase4.apache.org,40903,1676181799737' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-12 06:03:21,606 DEBUG [member: 'jenkins-hbase4.apache.org,39847,1676181799707' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-12 06:03:21,606 DEBUG [member: 'jenkins-hbase4.apache.org,39847,1676181799707' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-12 06:03:21,606 DEBUG [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:21,606 DEBUG [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 06:03:21,606 DEBUG [member: 'jenkins-hbase4.apache.org,39847,1676181799707' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,39847,1676181799707' in zk 2023-02-12 06:03:21,608 DEBUG [member: 'jenkins-hbase4.apache.org,39847,1676181799707' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-12 06:03:21,608 DEBUG [member: 'jenkins-hbase4.apache.org,39847,1676181799707' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:03:21,608 DEBUG [member: 'jenkins-hbase4.apache.org,39847,1676181799707' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-12 06:03:21,610 DEBUG [member: 'jenkins-hbase4.apache.org,40903,1676181799737' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-12 06:03:21,610 DEBUG [member: 'jenkins-hbase4.apache.org,40903,1676181799737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 06:03:21,610 DEBUG [rs(jenkins-hbase4.apache.org,40903,1676181799737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa. 2023-02-12 06:03:21,611 DEBUG [rs(jenkins-hbase4.apache.org,40903,1676181799737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa. started... 2023-02-12 06:03:21,611 INFO [rs(jenkins-hbase4.apache.org,40903,1676181799737)-snapshot-pool-0] regionserver.HRegion(2744): Flushing bcf2f6cd7aa91a19057352b677a2b5fa 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-12 06:03:21,630 INFO [rs(jenkins-hbase4.apache.org,40903,1676181799737)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/.tmp/f1/cb451af86770475fb5e2b6d5885a62ae 2023-02-12 06:03:21,653 INFO [rs(jenkins-hbase4.apache.org,40903,1676181799737)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/.tmp/f2/27952ca5fcee4d589780025fba9190d3 2023-02-12 06:03:21,658 DEBUG [rs(jenkins-hbase4.apache.org,40903,1676181799737)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/.tmp/f1/cb451af86770475fb5e2b6d5885a62ae as hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/f1/cb451af86770475fb5e2b6d5885a62ae 2023-02-12 06:03:21,661 DEBUG [Listener at localhost/46459] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 06:03:21,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-12 06:03:21,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-12 06:03:21,662 DEBUG [Listener at localhost/46459] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-12 06:03:21,663 INFO [rs(jenkins-hbase4.apache.org,40903,1676181799737)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/f1/cb451af86770475fb5e2b6d5885a62ae, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-12 06:03:21,663 DEBUG [rs(jenkins-hbase4.apache.org,40903,1676181799737)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/.tmp/f2/27952ca5fcee4d589780025fba9190d3 as hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/f2/27952ca5fcee4d589780025fba9190d3 2023-02-12 06:03:21,667 INFO [rs(jenkins-hbase4.apache.org,40903,1676181799737)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/f2/27952ca5fcee4d589780025fba9190d3, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-12 06:03:21,672 INFO [rs(jenkins-hbase4.apache.org,40903,1676181799737)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for bcf2f6cd7aa91a19057352b677a2b5fa in 61ms, sequenceid=5, compaction requested=false 2023-02-12 06:03:21,672 DEBUG [rs(jenkins-hbase4.apache.org,40903,1676181799737)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-12 06:03:21,673 DEBUG [rs(jenkins-hbase4.apache.org,40903,1676181799737)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for bcf2f6cd7aa91a19057352b677a2b5fa: 2023-02-12 06:03:21,673 DEBUG [rs(jenkins-hbase4.apache.org,40903,1676181799737)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,673 DEBUG [rs(jenkins-hbase4.apache.org,40903,1676181799737)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 06:03:21,673 DEBUG [rs(jenkins-hbase4.apache.org,40903,1676181799737)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/f1/cb451af86770475fb5e2b6d5885a62ae] hfiles 2023-02-12 06:03:21,673 DEBUG [rs(jenkins-hbase4.apache.org,40903,1676181799737)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/f1/cb451af86770475fb5e2b6d5885a62ae for snapshot=testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,673 DEBUG [rs(jenkins-hbase4.apache.org,40903,1676181799737)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/f2/27952ca5fcee4d589780025fba9190d3] hfiles 2023-02-12 06:03:21,673 DEBUG [rs(jenkins-hbase4.apache.org,40903,1676181799737)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/f2/27952ca5fcee4d589780025fba9190d3 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,685 DEBUG [rs(jenkins-hbase4.apache.org,40903,1676181799737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa. completed. 2023-02-12 06:03:21,686 DEBUG [rs(jenkins-hbase4.apache.org,40903,1676181799737)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa. 2023-02-12 06:03:21,686 DEBUG [member: 'jenkins-hbase4.apache.org,40903,1676181799737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-12 06:03:21,686 DEBUG [member: 'jenkins-hbase4.apache.org,40903,1676181799737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-12 06:03:21,686 DEBUG [member: 'jenkins-hbase4.apache.org,40903,1676181799737' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:21,686 DEBUG [member: 'jenkins-hbase4.apache.org,40903,1676181799737' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-12 06:03:21,686 DEBUG [member: 'jenkins-hbase4.apache.org,40903,1676181799737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,40903,1676181799737' in zk 2023-02-12 06:03:21,690 DEBUG [member: 'jenkins-hbase4.apache.org,40903,1676181799737' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-12 06:03:21,690 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:21,690 DEBUG [member: 'jenkins-hbase4.apache.org,40903,1676181799737' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:03:21,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:21,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:21,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 06:03:21,690 DEBUG [member: 'jenkins-hbase4.apache.org,40903,1676181799737' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-12 06:03:21,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:21,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:21,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:21,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39847,1676181799707 2023-02-12 06:03:21,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:21,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:21,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39847,1676181799707 2023-02-12 06:03:21,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,40903,1676181799737': 2023-02-12 06:03:21,694 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40903,1676181799737' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-12 06:03:21,694 INFO [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-12 06:03:21,694 DEBUG [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 06:03:21,694 DEBUG [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 06:03:21,694 DEBUG [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,694 INFO [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-12 06:03:21,696 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): regionserver:39847-0x10047206c980001, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,696 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): regionserver:39847-0x10047206c980001, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 06:03:21,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,696 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): regionserver:40903-0x10047206c980002, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,696 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): regionserver:40903-0x10047206c980002, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 06:03:21,696 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:21,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 06:03:21,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:03:21,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 06:03:21,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 06:03:21,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:03:21,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:21,697 DEBUG [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:21,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,698 DEBUG [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,39847,1676181799707 2023-02-12 06:03:21,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:21,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:21,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39847,1676181799707 2023-02-12 06:03:21,700 DEBUG [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:21,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:21,700 DEBUG [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,39847,1676181799707 2023-02-12 06:03:21,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:21,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39847,1676181799707 2023-02-12 06:03:21,706 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,39847,1676181799707 2023-02-12 06:03:21,706 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,706 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): regionserver:39847-0x10047206c980001, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 06:03:21,706 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:21,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 06:03:21,706 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:03:21,706 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): regionserver:39847-0x10047206c980001, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 06:03:21,706 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,706 DEBUG [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:03:21,706 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,706 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,39847,1676181799707 2023-02-12 06:03:21,706 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,706 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:21,706 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,706 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,706 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): regionserver:40903-0x10047206c980002, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 06:03:21,706 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): regionserver:40903-0x10047206c980002, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 06:03:21,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 06:03:21,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 06:03:21,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:03:21,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:03:21,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 06:03:21,707 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:03:21,735 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,769 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-12 06:03:21,769 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,769 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:21,769 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1676181801559Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1676181801706 (+147 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1676181801706Writing data manifest for testWithMockedMapReduceSingleRegion at 1676181801709 (+3 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1676181801729 (+20 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1676181801769 (+40 ms) 2023-02-12 06:03:21,773 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-12 06:03:21,774 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 213 msec 2023-02-12 06:03:21,863 DEBUG [Listener at localhost/46459] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 06:03:21,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-12 06:03:21,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-12 06:03:21,864 INFO [Listener at localhost/46459] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-12 06:03:21,868 INFO [Listener at localhost/46459] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-12 06:03:21,874 INFO [Listener at localhost/46459] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-12 06:03:21,906 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40903] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa. 2023-02-12 06:03:22,065 INFO [Listener at localhost/46459] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-12 06:03:22,071 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-12 06:03:22,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,074 INFO [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-12 06:03:22,074 DEBUG [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 06:03:22,075 DEBUG [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-12 06:03:22,075 DEBUG [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-12 06:03:22,076 DEBUG [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,076 DEBUG [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,078 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): regionserver:39847-0x10047206c980001, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 06:03:22,078 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): regionserver:40903-0x10047206c980002, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 06:03:22,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 06:03:22,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:03:22,078 DEBUG [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:22,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 06:03:22,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:03:22,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,078 DEBUG [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:22,078 DEBUG [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 06:03:22,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,079 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39847-0x10047206c980001, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,079 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40903-0x10047206c980002, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 06:03:22,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,079 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 06:03:22,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,079 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,080 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,080 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,080 DEBUG [member: 'jenkins-hbase4.apache.org,39847,1676181799707' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-12 06:03:22,080 DEBUG [member: 'jenkins-hbase4.apache.org,39847,1676181799707' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 06:03:22,080 DEBUG [member: 'jenkins-hbase4.apache.org,40903,1676181799737' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-12 06:03:22,081 DEBUG [member: 'jenkins-hbase4.apache.org,40903,1676181799737' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 06:03:22,081 DEBUG [member: 'jenkins-hbase4.apache.org,39847,1676181799707' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-12 06:03:22,081 DEBUG [member: 'jenkins-hbase4.apache.org,39847,1676181799707' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-12 06:03:22,082 DEBUG [member: 'jenkins-hbase4.apache.org,39847,1676181799707' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39847,1676181799707' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-12 06:03:22,082 DEBUG [member: 'jenkins-hbase4.apache.org,40903,1676181799737' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-12 06:03:22,082 DEBUG [member: 'jenkins-hbase4.apache.org,40903,1676181799737' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 06:03:22,082 DEBUG [member: 'jenkins-hbase4.apache.org,40903,1676181799737' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 06:03:22,082 DEBUG [rs(jenkins-hbase4.apache.org,40903,1676181799737)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa. 2023-02-12 06:03:22,082 DEBUG [rs(jenkins-hbase4.apache.org,40903,1676181799737)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa. started... 2023-02-12 06:03:22,082 INFO [rs(jenkins-hbase4.apache.org,40903,1676181799737)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing bcf2f6cd7aa91a19057352b677a2b5fa 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-12 06:03:22,084 DEBUG [member: 'jenkins-hbase4.apache.org,39847,1676181799707' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,084 DEBUG [member: 'jenkins-hbase4.apache.org,39847,1676181799707' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39847-0x10047206c980001, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,084 DEBUG [member: 'jenkins-hbase4.apache.org,39847,1676181799707' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 06:03:22,097 INFO [rs(jenkins-hbase4.apache.org,40903,1676181799737)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/.tmp/f1/da523f9b094a428b9ac4be7b34064b74 2023-02-12 06:03:22,115 INFO [rs(jenkins-hbase4.apache.org,40903,1676181799737)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/.tmp/f2/70f2321cc775491e8b10fa8b81e8a61a 2023-02-12 06:03:22,119 DEBUG [rs(jenkins-hbase4.apache.org,40903,1676181799737)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/.tmp/f1/da523f9b094a428b9ac4be7b34064b74 as hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/f1/da523f9b094a428b9ac4be7b34064b74 2023-02-12 06:03:22,123 INFO [rs(jenkins-hbase4.apache.org,40903,1676181799737)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/f1/da523f9b094a428b9ac4be7b34064b74, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-12 06:03:22,124 DEBUG [rs(jenkins-hbase4.apache.org,40903,1676181799737)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/.tmp/f2/70f2321cc775491e8b10fa8b81e8a61a as hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/f2/70f2321cc775491e8b10fa8b81e8a61a 2023-02-12 06:03:22,127 INFO [rs(jenkins-hbase4.apache.org,40903,1676181799737)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/f2/70f2321cc775491e8b10fa8b81e8a61a, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-12 06:03:22,128 INFO [rs(jenkins-hbase4.apache.org,40903,1676181799737)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for bcf2f6cd7aa91a19057352b677a2b5fa in 46ms, sequenceid=9, compaction requested=false 2023-02-12 06:03:22,129 DEBUG [rs(jenkins-hbase4.apache.org,40903,1676181799737)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for bcf2f6cd7aa91a19057352b677a2b5fa: 2023-02-12 06:03:22,129 DEBUG [rs(jenkins-hbase4.apache.org,40903,1676181799737)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa. 2023-02-12 06:03:22,129 DEBUG [member: 'jenkins-hbase4.apache.org,40903,1676181799737' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 06:03:22,130 DEBUG [member: 'jenkins-hbase4.apache.org,40903,1676181799737' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 06:03:22,130 DEBUG [member: 'jenkins-hbase4.apache.org,40903,1676181799737' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:22,130 DEBUG [member: 'jenkins-hbase4.apache.org,40903,1676181799737' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-12 06:03:22,130 DEBUG [member: 'jenkins-hbase4.apache.org,40903,1676181799737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40903,1676181799737' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-12 06:03:22,131 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:22,131 DEBUG [member: 'jenkins-hbase4.apache.org,40903,1676181799737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:22,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:22,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 06:03:22,132 DEBUG [member: 'jenkins-hbase4.apache.org,40903,1676181799737' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40903-0x10047206c980002, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,132 DEBUG [member: 'jenkins-hbase4.apache.org,40903,1676181799737' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 06:03:22,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:22,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:22,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:22,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39847,1676181799707 2023-02-12 06:03:22,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:22,133 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40903,1676181799737' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-12 06:03:22,133 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44e49f47[Count = 0] remaining members to acquire global barrier 2023-02-12 06:03:22,133 DEBUG [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-12 06:03:22,134 DEBUG [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,135 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): regionserver:39847-0x10047206c980001, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,135 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): regionserver:40903-0x10047206c980002, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,135 DEBUG [member: 'jenkins-hbase4.apache.org,39847,1676181799707' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-12 06:03:22,135 DEBUG [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:22,135 DEBUG [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 06:03:22,135 DEBUG [member: 'jenkins-hbase4.apache.org,39847,1676181799707' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-12 06:03:22,135 DEBUG [member: 'jenkins-hbase4.apache.org,40903,1676181799737' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-12 06:03:22,135 DEBUG [member: 'jenkins-hbase4.apache.org,40903,1676181799737' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-12 06:03:22,135 DEBUG [member: 'jenkins-hbase4.apache.org,40903,1676181799737' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,40903,1676181799737' in zk 2023-02-12 06:03:22,135 DEBUG [member: 'jenkins-hbase4.apache.org,39847,1676181799707' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,39847,1676181799707' in zk 2023-02-12 06:03:22,138 DEBUG [member: 'jenkins-hbase4.apache.org,39847,1676181799707' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-12 06:03:22,138 DEBUG [member: 'jenkins-hbase4.apache.org,39847,1676181799707' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:03:22,138 DEBUG [member: 'jenkins-hbase4.apache.org,39847,1676181799707' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-12 06:03:22,139 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:22,139 DEBUG [member: 'jenkins-hbase4.apache.org,40903,1676181799737' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-12 06:03:22,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:22,139 DEBUG [member: 'jenkins-hbase4.apache.org,40903,1676181799737' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:03:22,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:22,139 DEBUG [member: 'jenkins-hbase4.apache.org,40903,1676181799737' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-12 06:03:22,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 06:03:22,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:22,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:22,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:22,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39847,1676181799707 2023-02-12 06:03:22,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:22,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:22,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39847,1676181799707 2023-02-12 06:03:22,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,40903,1676181799737': 2023-02-12 06:03:22,142 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40903,1676181799737' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-12 06:03:22,142 INFO [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-12 06:03:22,142 DEBUG [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 06:03:22,142 DEBUG [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 06:03:22,142 DEBUG [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,142 INFO [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 06:03:22,143 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): regionserver:39847-0x10047206c980001, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,143 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): regionserver:40903-0x10047206c980002, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,143 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): regionserver:40903-0x10047206c980002, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 06:03:22,143 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): regionserver:39847-0x10047206c980001, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 06:03:22,143 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:22,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 06:03:22,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 06:03:22,144 DEBUG [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:22,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 06:03:22,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:03:22,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:03:22,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:22,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,145 DEBUG [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,39847,1676181799707 2023-02-12 06:03:22,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:22,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:22,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39847,1676181799707 2023-02-12 06:03:22,146 DEBUG [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:22,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:22,146 DEBUG [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,39847,1676181799707 2023-02-12 06:03:22,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:22,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39847,1676181799707 2023-02-12 06:03:22,149 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,39847,1676181799707 2023-02-12 06:03:22,149 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,149 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): regionserver:39847-0x10047206c980001, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 06:03:22,149 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:22,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 06:03:22,149 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,149 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-12 06:03:22,149 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 06:03:22,149 DEBUG [(jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:03:22,149 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): regionserver:39847-0x10047206c980001, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 06:03:22,149 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): regionserver:40903-0x10047206c980002, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 06:03:22,149 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,39847,1676181799707 2023-02-12 06:03:22,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:03:22,149 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,149 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): regionserver:40903-0x10047206c980002, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 06:03:22,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 06:03:22,149 DEBUG [Listener at localhost/46459] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-12 06:03:22,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 06:03:22,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:03:22,150 DEBUG [Listener at localhost/46459] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 06:03:22,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:03:22,149 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:22,150 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,150 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 06:03:22,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:03:22,250 DEBUG [Listener at localhost/46459] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 06:03:22,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 06:03:22,257 INFO [Listener at localhost/46459] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676181801541 type: FLUSH version: 2 ttl: 0 2023-02-12 06:03:22,257 DEBUG [Listener at localhost/46459] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:35673/user/jenkins/test-data/a566fe58-e016-9912-6a3a-f700cc6beee9/testWithMockedMapReduceSingleRegion/b1a4a7b3-7ff8-4df8-a260-8fbe152733df/data/default/testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,257 INFO [Listener at localhost/46459] snapshot.RestoreSnapshotHelper(239): region to add: bcf2f6cd7aa91a19057352b677a2b5fa 2023-02-12 06:03:22,257 INFO [Listener at localhost/46459] snapshot.RestoreSnapshotHelper(585): clone region=bcf2f6cd7aa91a19057352b677a2b5fa as bcf2f6cd7aa91a19057352b677a2b5fa in snapshot testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,258 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => bcf2f6cd7aa91a19057352b677a2b5fa, NAME => 'testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35673/user/jenkins/test-data/a566fe58-e016-9912-6a3a-f700cc6beee9/testWithMockedMapReduceSingleRegion/b1a4a7b3-7ff8-4df8-a260-8fbe152733df 2023-02-12 06:03:22,265 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:22,265 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink cb451af86770475fb5e2b6d5885a62ae from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,266 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 27952ca5fcee4d589780025fba9190d3 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,268 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing bcf2f6cd7aa91a19057352b677a2b5fa, disabling compactions & flushes 2023-02-12 06:03:22,268 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa. 2023-02-12 06:03:22,268 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa. 2023-02-12 06:03:22,268 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa. after waiting 0 ms 2023-02-12 06:03:22,268 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa. 2023-02-12 06:03:22,269 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa. 2023-02-12 06:03:22,269 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for bcf2f6cd7aa91a19057352b677a2b5fa: Waiting for close lock at 1676181802268Disabling compacts and flushes for region at 1676181802268Disabling writes for close at 1676181802268Writing region close event to WAL at 1676181802269 (+1 ms)Closed at 1676181802269 2023-02-12 06:03:22,269 INFO [Listener at localhost/46459] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676181801541 type: FLUSH version: 2 ttl: 0 2023-02-12 06:03:22,269 DEBUG [Listener at localhost/46459] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:35673/user/jenkins/test-data/a566fe58-e016-9912-6a3a-f700cc6beee9/testWithMockedMapReduceSingleRegion/b1a4a7b3-7ff8-4df8-a260-8fbe152733df 2023-02-12 06:03:22,269 DEBUG [Listener at localhost/46459] util.CommonFSUtils(682): File system contents for path hdfs://localhost:35673/user/jenkins/test-data/a566fe58-e016-9912-6a3a-f700cc6beee9/testWithMockedMapReduceSingleRegion/b1a4a7b3-7ff8-4df8-a260-8fbe152733df 2023-02-12 06:03:22,269 DEBUG [Listener at localhost/46459] util.CommonFSUtils(699): |-data/ 2023-02-12 06:03:22,270 DEBUG [Listener at localhost/46459] util.CommonFSUtils(699): |----default/ 2023-02-12 06:03:22,270 DEBUG [Listener at localhost/46459] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-12 06:03:22,270 DEBUG [Listener at localhost/46459] util.CommonFSUtils(699): |----------bcf2f6cd7aa91a19057352b677a2b5fa/ 2023-02-12 06:03:22,271 DEBUG [Listener at localhost/46459] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 06:03:22,271 DEBUG [Listener at localhost/46459] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 06:03:22,271 DEBUG [Listener at localhost/46459] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=bcf2f6cd7aa91a19057352b677a2b5fa-cb451af86770475fb5e2b6d5885a62ae 2023-02-12 06:03:22,271 DEBUG [Listener at localhost/46459] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 06:03:22,271 DEBUG [Listener at localhost/46459] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=bcf2f6cd7aa91a19057352b677a2b5fa-27952ca5fcee4d589780025fba9190d3 2023-02-12 06:03:22,275 INFO [Listener at localhost/46459] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-12 06:03:22,278 DEBUG [Listener at localhost/46459] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:22,278 INFO [Listener at localhost/46459] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 06:03:22,279 DEBUG [Listener at localhost/46459] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:03:22,281 INFO [StoreOpener-bcf2f6cd7aa91a19057352b677a2b5fa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bcf2f6cd7aa91a19057352b677a2b5fa 2023-02-12 06:03:22,281 DEBUG [StoreOpener-bcf2f6cd7aa91a19057352b677a2b5fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35673/user/jenkins/test-data/a566fe58-e016-9912-6a3a-f700cc6beee9/testWithMockedMapReduceSingleRegion/b1a4a7b3-7ff8-4df8-a260-8fbe152733df/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/f1 2023-02-12 06:03:22,282 INFO [StoreOpener-bcf2f6cd7aa91a19057352b677a2b5fa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bcf2f6cd7aa91a19057352b677a2b5fa columnFamilyName f1 2023-02-12 06:03:22,286 DEBUG [StoreOpener-bcf2f6cd7aa91a19057352b677a2b5fa-1] regionserver.HStore(539): loaded hdfs://localhost:35673/user/jenkins/test-data/a566fe58-e016-9912-6a3a-f700cc6beee9/testWithMockedMapReduceSingleRegion/b1a4a7b3-7ff8-4df8-a260-8fbe152733df/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/f1/testWithMockedMapReduceSingleRegion=bcf2f6cd7aa91a19057352b677a2b5fa-cb451af86770475fb5e2b6d5885a62ae 2023-02-12 06:03:22,286 INFO [StoreOpener-bcf2f6cd7aa91a19057352b677a2b5fa-1] regionserver.HStore(310): Store=bcf2f6cd7aa91a19057352b677a2b5fa/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:22,286 INFO [StoreOpener-bcf2f6cd7aa91a19057352b677a2b5fa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bcf2f6cd7aa91a19057352b677a2b5fa 2023-02-12 06:03:22,287 DEBUG [StoreOpener-bcf2f6cd7aa91a19057352b677a2b5fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35673/user/jenkins/test-data/a566fe58-e016-9912-6a3a-f700cc6beee9/testWithMockedMapReduceSingleRegion/b1a4a7b3-7ff8-4df8-a260-8fbe152733df/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/f2 2023-02-12 06:03:22,287 INFO [StoreOpener-bcf2f6cd7aa91a19057352b677a2b5fa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bcf2f6cd7aa91a19057352b677a2b5fa columnFamilyName f2 2023-02-12 06:03:22,290 DEBUG [StoreOpener-bcf2f6cd7aa91a19057352b677a2b5fa-1] regionserver.HStore(539): loaded hdfs://localhost:35673/user/jenkins/test-data/a566fe58-e016-9912-6a3a-f700cc6beee9/testWithMockedMapReduceSingleRegion/b1a4a7b3-7ff8-4df8-a260-8fbe152733df/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/f2/testWithMockedMapReduceSingleRegion=bcf2f6cd7aa91a19057352b677a2b5fa-27952ca5fcee4d589780025fba9190d3 2023-02-12 06:03:22,290 INFO [StoreOpener-bcf2f6cd7aa91a19057352b677a2b5fa-1] regionserver.HStore(310): Store=bcf2f6cd7aa91a19057352b677a2b5fa/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:22,291 DEBUG [Listener at localhost/46459] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:03:22,291 INFO [Listener at localhost/46459] regionserver.HRegion(1071): Opened bcf2f6cd7aa91a19057352b677a2b5fa; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64591821, jitterRate=-0.037506863474845886}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:03:22,291 DEBUG [Listener at localhost/46459] regionserver.HRegion(964): Region open journal for bcf2f6cd7aa91a19057352b677a2b5fa: Writing region info on filesystem at 1676181802279Initializing all the Stores at 1676181802279Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181802279Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181802279Region opened successfully at 1676181802291 (+12 ms) 2023-02-12 06:03:22,354 DEBUG [Listener at localhost/46459] regionserver.HRegion(1603): Closing bcf2f6cd7aa91a19057352b677a2b5fa, disabling compactions & flushes 2023-02-12 06:03:22,354 INFO [Listener at localhost/46459] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa. 2023-02-12 06:03:22,354 DEBUG [Listener at localhost/46459] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa. 2023-02-12 06:03:22,354 DEBUG [Listener at localhost/46459] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa. after waiting 0 ms 2023-02-12 06:03:22,354 DEBUG [Listener at localhost/46459] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa. 2023-02-12 06:03:22,355 INFO [Listener at localhost/46459] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa. 2023-02-12 06:03:22,355 DEBUG [Listener at localhost/46459] regionserver.HRegion(1557): Region close journal for bcf2f6cd7aa91a19057352b677a2b5fa: Waiting for close lock at 1676181802354Disabling compacts and flushes for region at 1676181802354Disabling writes for close at 1676181802354Writing region close event to WAL at 1676181802355 (+1 ms)Closed at 1676181802355 2023-02-12 06:03:22,359 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-12 06:03:22,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,363 INFO [Listener at localhost/46459] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,363 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,366 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676181802366"}]},"ts":"1676181802366"} 2023-02-12 06:03:22,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 06:03:22,368 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-12 06:03:22,370 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-12 06:03:22,371 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=bcf2f6cd7aa91a19057352b677a2b5fa, UNASSIGN}] 2023-02-12 06:03:22,373 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=bcf2f6cd7aa91a19057352b677a2b5fa, UNASSIGN 2023-02-12 06:03:22,373 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=bcf2f6cd7aa91a19057352b677a2b5fa, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:22,373 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676181802373"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181802373"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181802373"}]},"ts":"1676181802373"} 2023-02-12 06:03:22,375 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure bcf2f6cd7aa91a19057352b677a2b5fa, server=jenkins-hbase4.apache.org,40903,1676181799737}] 2023-02-12 06:03:22,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 06:03:22,527 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close bcf2f6cd7aa91a19057352b677a2b5fa 2023-02-12 06:03:22,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing bcf2f6cd7aa91a19057352b677a2b5fa, disabling compactions & flushes 2023-02-12 06:03:22,527 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa. 2023-02-12 06:03:22,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa. 2023-02-12 06:03:22,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa. after waiting 0 ms 2023-02-12 06:03:22,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa. 2023-02-12 06:03:22,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 06:03:22,532 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa. 2023-02-12 06:03:22,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for bcf2f6cd7aa91a19057352b677a2b5fa: Waiting for close lock at 1676181802527Running coprocessor pre-close hooks at 1676181802527Disabling compacts and flushes for region at 1676181802527Disabling writes for close at 1676181802527Writing region close event to WAL at 1676181802528 (+1 ms)Running coprocessor post-close hooks at 1676181802532 (+4 ms)Closed at 1676181802532 2023-02-12 06:03:22,533 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed bcf2f6cd7aa91a19057352b677a2b5fa 2023-02-12 06:03:22,534 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=bcf2f6cd7aa91a19057352b677a2b5fa, regionState=CLOSED 2023-02-12 06:03:22,534 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676181802534"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181802534"}]},"ts":"1676181802534"} 2023-02-12 06:03:22,536 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-12 06:03:22,536 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure bcf2f6cd7aa91a19057352b677a2b5fa, server=jenkins-hbase4.apache.org,40903,1676181799737 in 160 msec 2023-02-12 06:03:22,537 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-12 06:03:22,537 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=bcf2f6cd7aa91a19057352b677a2b5fa, UNASSIGN in 165 msec 2023-02-12 06:03:22,538 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676181802538"}]},"ts":"1676181802538"} 2023-02-12 06:03:22,539 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-12 06:03:22,541 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-12 06:03:22,542 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 178 msec 2023-02-12 06:03:22,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 06:03:22,670 INFO [Listener at localhost/46459] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-12 06:03:22,671 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,673 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,674 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-12 06:03:22,677 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/.tmp/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa 2023-02-12 06:03:22,679 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/.tmp/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/f1, FileablePath, hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/.tmp/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/f2, FileablePath, hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/.tmp/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/recovered.edits] 2023-02-12 06:03:22,682 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/.tmp/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/f1/cb451af86770475fb5e2b6d5885a62ae to hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/archive/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/f1/cb451af86770475fb5e2b6d5885a62ae 2023-02-12 06:03:22,684 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/.tmp/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/f1/da523f9b094a428b9ac4be7b34064b74 to hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/archive/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/f1/da523f9b094a428b9ac4be7b34064b74 2023-02-12 06:03:22,686 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/.tmp/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/f2/27952ca5fcee4d589780025fba9190d3 to hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/archive/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/f2/27952ca5fcee4d589780025fba9190d3 2023-02-12 06:03:22,687 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/.tmp/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/f2/70f2321cc775491e8b10fa8b81e8a61a to hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/archive/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/f2/70f2321cc775491e8b10fa8b81e8a61a 2023-02-12 06:03:22,689 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/.tmp/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/recovered.edits/12.seqid to hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/archive/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa/recovered.edits/12.seqid 2023-02-12 06:03:22,690 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/.tmp/data/default/testWithMockedMapReduceSingleRegion/bcf2f6cd7aa91a19057352b677a2b5fa 2023-02-12 06:03:22,690 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-12 06:03:22,692 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,693 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-12 06:03:22,695 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-12 06:03:22,696 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,696 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-12 06:03:22,696 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676181802696"}]},"ts":"9223372036854775807"} 2023-02-12 06:03:22,697 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-12 06:03:22,697 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => bcf2f6cd7aa91a19057352b677a2b5fa, NAME => 'testWithMockedMapReduceSingleRegion,,1676181800776.bcf2f6cd7aa91a19057352b677a2b5fa.', STARTKEY => '', ENDKEY => ''}] 2023-02-12 06:03:22,697 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-12 06:03:22,697 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676181802697"}]},"ts":"9223372036854775807"} 2023-02-12 06:03:22,698 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-12 06:03:22,700 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-12 06:03:22,701 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 29 msec 2023-02-12 06:03:22,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=32905] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-12 06:03:22,776 INFO [Listener at localhost/46459] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-12 06:03:22,776 INFO [Listener at localhost/46459] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-12 06:03:22,777 INFO [Listener at localhost/46459] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 06:03:22,777 DEBUG [Listener at localhost/46459] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e1c7ce1 to 127.0.0.1:53582 2023-02-12 06:03:22,777 DEBUG [Listener at localhost/46459] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:22,777 DEBUG [Listener at localhost/46459] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-12 06:03:22,777 DEBUG [Listener at localhost/46459] util.JVMClusterUtil(257): Found active master hash=1744695223, stopped=false 2023-02-12 06:03:22,777 INFO [Listener at localhost/46459] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,32905,1676181799655 2023-02-12 06:03:22,780 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): regionserver:39847-0x10047206c980001, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 06:03:22,780 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 06:03:22,780 INFO [Listener at localhost/46459] procedure2.ProcedureExecutor(629): Stopping 2023-02-12 06:03:22,780 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): regionserver:40903-0x10047206c980002, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 06:03:22,780 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:22,782 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39847-0x10047206c980001, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:03:22,782 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:03:22,782 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40903-0x10047206c980002, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:03:22,783 DEBUG [Listener at localhost/46459] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5cb841ea to 127.0.0.1:53582 2023-02-12 06:03:22,783 DEBUG [Listener at localhost/46459] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:22,783 INFO [Listener at localhost/46459] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39847,1676181799707' ***** 2023-02-12 06:03:22,783 INFO [Listener at localhost/46459] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 06:03:22,783 INFO [Listener at localhost/46459] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40903,1676181799737' ***** 2023-02-12 06:03:22,783 INFO [Listener at localhost/46459] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 06:03:22,783 INFO [RS:1;jenkins-hbase4:40903] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 06:03:22,783 INFO [RS:1;jenkins-hbase4:40903] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 06:03:22,783 INFO [RS:0;jenkins-hbase4:39847] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 06:03:22,783 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 06:03:22,784 INFO [RS:0;jenkins-hbase4:39847] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 06:03:22,784 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 06:03:22,784 INFO [RS:0;jenkins-hbase4:39847] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 06:03:22,783 INFO [RS:1;jenkins-hbase4:40903] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 06:03:22,785 INFO [RS:0;jenkins-hbase4:39847] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39847,1676181799707 2023-02-12 06:03:22,785 INFO [RS:1;jenkins-hbase4:40903] regionserver.HRegionServer(3304): Received CLOSE for 7befabc880c6bfc62f9f759f3569e505 2023-02-12 06:03:22,785 DEBUG [RS:0;jenkins-hbase4:39847] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73124062 to 127.0.0.1:53582 2023-02-12 06:03:22,785 INFO [RS:1;jenkins-hbase4:40903] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:22,785 DEBUG [RS:0;jenkins-hbase4:39847] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:22,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7befabc880c6bfc62f9f759f3569e505, disabling compactions & flushes 2023-02-12 06:03:22,785 INFO [RS:0;jenkins-hbase4:39847] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39847,1676181799707; all regions closed. 2023-02-12 06:03:22,785 DEBUG [RS:1;jenkins-hbase4:40903] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b21bfb0 to 127.0.0.1:53582 2023-02-12 06:03:22,785 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676181800298.7befabc880c6bfc62f9f759f3569e505. 2023-02-12 06:03:22,785 DEBUG [RS:1;jenkins-hbase4:40903] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:22,785 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676181800298.7befabc880c6bfc62f9f759f3569e505. 2023-02-12 06:03:22,785 INFO [RS:1;jenkins-hbase4:40903] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 06:03:22,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676181800298.7befabc880c6bfc62f9f759f3569e505. after waiting 0 ms 2023-02-12 06:03:22,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676181800298.7befabc880c6bfc62f9f759f3569e505. 2023-02-12 06:03:22,786 INFO [RS:1;jenkins-hbase4:40903] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 06:03:22,786 INFO [RS:1;jenkins-hbase4:40903] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 06:03:22,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 7befabc880c6bfc62f9f759f3569e505 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-12 06:03:22,786 INFO [RS:1;jenkins-hbase4:40903] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-12 06:03:22,786 INFO [RS:1;jenkins-hbase4:40903] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-12 06:03:22,786 DEBUG [RS:1;jenkins-hbase4:40903] regionserver.HRegionServer(1479): Online Regions={7befabc880c6bfc62f9f759f3569e505=hbase:namespace,,1676181800298.7befabc880c6bfc62f9f759f3569e505., 1588230740=hbase:meta,,1.1588230740} 2023-02-12 06:03:22,786 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 06:03:22,786 DEBUG [RS:1;jenkins-hbase4:40903] regionserver.HRegionServer(1505): Waiting on 1588230740, 7befabc880c6bfc62f9f759f3569e505 2023-02-12 06:03:22,786 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 06:03:22,786 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 06:03:22,786 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 06:03:22,786 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 06:03:22,786 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-12 06:03:22,790 DEBUG [RS:0;jenkins-hbase4:39847] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/oldWALs 2023-02-12 06:03:22,790 INFO [RS:0;jenkins-hbase4:39847] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39847%2C1676181799707:(num 1676181801053) 2023-02-12 06:03:22,790 DEBUG [RS:0;jenkins-hbase4:39847] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:22,790 INFO [RS:0;jenkins-hbase4:39847] regionserver.LeaseManager(133): Closed leases 2023-02-12 06:03:22,791 INFO [RS:0;jenkins-hbase4:39847] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-12 06:03:22,791 INFO [RS:0;jenkins-hbase4:39847] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 06:03:22,791 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 06:03:22,791 INFO [RS:0;jenkins-hbase4:39847] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 06:03:22,791 INFO [RS:0;jenkins-hbase4:39847] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 06:03:22,792 INFO [RS:0;jenkins-hbase4:39847] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39847 2023-02-12 06:03:22,798 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 06:03:22,798 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): regionserver:39847-0x10047206c980001, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39847,1676181799707 2023-02-12 06:03:22,798 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): regionserver:40903-0x10047206c980002, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39847,1676181799707 2023-02-12 06:03:22,798 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): regionserver:40903-0x10047206c980002, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 06:03:22,800 ERROR [Listener at localhost/46459-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@15fd595f rejected from java.util.concurrent.ThreadPoolExecutor@11c2df38[Terminated, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:22,800 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/hbase/namespace/7befabc880c6bfc62f9f759f3569e505/.tmp/info/c5bdd70b8fdb4564994bf6898e62773c 2023-02-12 06:03:22,800 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): regionserver:39847-0x10047206c980001, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 06:03:22,800 ERROR [Listener at localhost/46459-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1a163540 rejected from java.util.concurrent.ThreadPoolExecutor@11c2df38[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:22,801 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39847,1676181799707] 2023-02-12 06:03:22,801 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39847,1676181799707; numProcessing=1 2023-02-12 06:03:22,802 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.57 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/hbase/meta/1588230740/.tmp/info/8eb61268a9884fe590135f58496019fc 2023-02-12 06:03:22,802 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39847,1676181799707 already deleted, retry=false 2023-02-12 06:03:22,802 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39847,1676181799707 expired; onlineServers=1 2023-02-12 06:03:22,805 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/hbase/namespace/7befabc880c6bfc62f9f759f3569e505/.tmp/info/c5bdd70b8fdb4564994bf6898e62773c as hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/hbase/namespace/7befabc880c6bfc62f9f759f3569e505/info/c5bdd70b8fdb4564994bf6898e62773c 2023-02-12 06:03:22,806 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8eb61268a9884fe590135f58496019fc 2023-02-12 06:03:22,809 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/hbase/namespace/7befabc880c6bfc62f9f759f3569e505/info/c5bdd70b8fdb4564994bf6898e62773c, entries=2, sequenceid=6, filesize=4.8 K 2023-02-12 06:03:22,810 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 7befabc880c6bfc62f9f759f3569e505 in 24ms, sequenceid=6, compaction requested=false 2023-02-12 06:03:22,813 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/hbase/namespace/7befabc880c6bfc62f9f759f3569e505/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-12 06:03:22,814 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/hbase/meta/1588230740/.tmp/rep_barrier/b91e334d12584323a80bdb54be4b6872 2023-02-12 06:03:22,814 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676181800298.7befabc880c6bfc62f9f759f3569e505. 2023-02-12 06:03:22,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7befabc880c6bfc62f9f759f3569e505: Waiting for close lock at 1676181802785Running coprocessor pre-close hooks at 1676181802785Disabling compacts and flushes for region at 1676181802785Disabling writes for close at 1676181802786 (+1 ms)Obtaining lock to block concurrent updates at 1676181802786Preparing flush snapshotting stores in 7befabc880c6bfc62f9f759f3569e505 at 1676181802786Finished memstore snapshotting hbase:namespace,,1676181800298.7befabc880c6bfc62f9f759f3569e505., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676181802786Flushing stores of hbase:namespace,,1676181800298.7befabc880c6bfc62f9f759f3569e505. at 1676181802787 (+1 ms)Flushing 7befabc880c6bfc62f9f759f3569e505/info: creating writer at 1676181802787Flushing 7befabc880c6bfc62f9f759f3569e505/info: appending metadata at 1676181802790 (+3 ms)Flushing 7befabc880c6bfc62f9f759f3569e505/info: closing flushed file at 1676181802790Flushing 7befabc880c6bfc62f9f759f3569e505/info: reopening flushed file at 1676181802806 (+16 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 7befabc880c6bfc62f9f759f3569e505 in 24ms, sequenceid=6, compaction requested=false at 1676181802810 (+4 ms)Writing region close event to WAL at 1676181802811 (+1 ms)Running coprocessor post-close hooks at 1676181802814 (+3 ms)Closed at 1676181802814 2023-02-12 06:03:22,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676181800298.7befabc880c6bfc62f9f759f3569e505. 2023-02-12 06:03:22,817 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b91e334d12584323a80bdb54be4b6872 2023-02-12 06:03:22,824 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/hbase/meta/1588230740/.tmp/table/d516d0a6b72748bdbbe6ecc5e4800a46 2023-02-12 06:03:22,827 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d516d0a6b72748bdbbe6ecc5e4800a46 2023-02-12 06:03:22,828 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/hbase/meta/1588230740/.tmp/info/8eb61268a9884fe590135f58496019fc as hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/hbase/meta/1588230740/info/8eb61268a9884fe590135f58496019fc 2023-02-12 06:03:22,833 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8eb61268a9884fe590135f58496019fc 2023-02-12 06:03:22,834 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/hbase/meta/1588230740/info/8eb61268a9884fe590135f58496019fc, entries=12, sequenceid=21, filesize=6.3 K 2023-02-12 06:03:22,834 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/hbase/meta/1588230740/.tmp/rep_barrier/b91e334d12584323a80bdb54be4b6872 as hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/hbase/meta/1588230740/rep_barrier/b91e334d12584323a80bdb54be4b6872 2023-02-12 06:03:22,838 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b91e334d12584323a80bdb54be4b6872 2023-02-12 06:03:22,839 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/hbase/meta/1588230740/rep_barrier/b91e334d12584323a80bdb54be4b6872, entries=1, sequenceid=21, filesize=5.0 K 2023-02-12 06:03:22,839 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/hbase/meta/1588230740/.tmp/table/d516d0a6b72748bdbbe6ecc5e4800a46 as hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/hbase/meta/1588230740/table/d516d0a6b72748bdbbe6ecc5e4800a46 2023-02-12 06:03:22,843 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d516d0a6b72748bdbbe6ecc5e4800a46 2023-02-12 06:03:22,843 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/hbase/meta/1588230740/table/d516d0a6b72748bdbbe6ecc5e4800a46, entries=4, sequenceid=21, filesize=5.1 K 2023-02-12 06:03:22,846 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 60ms, sequenceid=21, compaction requested=false 2023-02-12 06:03:22,850 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-12 06:03:22,851 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 06:03:22,851 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 06:03:22,851 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676181802786Running coprocessor pre-close hooks at 1676181802786Disabling compacts and flushes for region at 1676181802786Disabling writes for close at 1676181802786Obtaining lock to block concurrent updates at 1676181802786Preparing flush snapshotting stores in 1588230740 at 1676181802786Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4311, getHeapSize=7760, getOffHeapSize=0, getCellsCount=36 at 1676181802787 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1676181802787Flushing 1588230740/info: creating writer at 1676181802787Flushing 1588230740/info: appending metadata at 1676181802790 (+3 ms)Flushing 1588230740/info: closing flushed file at 1676181802790Flushing 1588230740/rep_barrier: creating writer at 1676181802806 (+16 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676181802808 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676181802808Flushing 1588230740/table: creating writer at 1676181802817 (+9 ms)Flushing 1588230740/table: appending metadata at 1676181802819 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676181802819Flushing 1588230740/info: reopening flushed file at 1676181802828 (+9 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676181802835 (+7 ms)Flushing 1588230740/table: reopening flushed file at 1676181802840 (+5 ms)Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 60ms, sequenceid=21, compaction requested=false at 1676181802846 (+6 ms)Writing region close event to WAL at 1676181802848 (+2 ms)Running coprocessor post-close hooks at 1676181802851 (+3 ms)Closed at 1676181802851 2023-02-12 06:03:22,851 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-12 06:03:22,867 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 06:03:22,871 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 06:03:22,979 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): regionserver:39847-0x10047206c980001, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:03:22,979 INFO [RS:0;jenkins-hbase4:39847] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39847,1676181799707; zookeeper connection closed. 2023-02-12 06:03:22,979 ERROR [Listener at localhost/46459-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@62e29860 rejected from java.util.concurrent.ThreadPoolExecutor@11c2df38[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:22,979 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): regionserver:39847-0x10047206c980001, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:03:22,979 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7b9e8f4a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7b9e8f4a 2023-02-12 06:03:22,979 ERROR [Listener at localhost/46459-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1ff833c3 rejected from java.util.concurrent.ThreadPoolExecutor@11c2df38[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:22,986 INFO [RS:1;jenkins-hbase4:40903] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40903,1676181799737; all regions closed. 2023-02-12 06:03:22,990 DEBUG [RS:1;jenkins-hbase4:40903] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/oldWALs 2023-02-12 06:03:22,990 INFO [RS:1;jenkins-hbase4:40903] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40903%2C1676181799737.meta:.meta(num 1676181800246) 2023-02-12 06:03:22,994 DEBUG [RS:1;jenkins-hbase4:40903] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/oldWALs 2023-02-12 06:03:22,994 INFO [RS:1;jenkins-hbase4:40903] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40903%2C1676181799737:(num 1676181800643) 2023-02-12 06:03:22,994 DEBUG [RS:1;jenkins-hbase4:40903] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:22,994 INFO [RS:1;jenkins-hbase4:40903] regionserver.LeaseManager(133): Closed leases 2023-02-12 06:03:22,994 INFO [RS:1;jenkins-hbase4:40903] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-12 06:03:22,994 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 06:03:22,995 INFO [RS:1;jenkins-hbase4:40903] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40903 2023-02-12 06:03:22,997 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): regionserver:40903-0x10047206c980002, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40903,1676181799737 2023-02-12 06:03:22,997 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 06:03:22,997 ERROR [Listener at localhost/46459-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@27c57c4a rejected from java.util.concurrent.ThreadPoolExecutor@23fafc6a[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:23,000 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40903,1676181799737] 2023-02-12 06:03:23,000 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40903,1676181799737; numProcessing=2 2023-02-12 06:03:23,001 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40903,1676181799737 already deleted, retry=false 2023-02-12 06:03:23,001 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40903,1676181799737 expired; onlineServers=0 2023-02-12 06:03:23,001 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,32905,1676181799655' ***** 2023-02-12 06:03:23,001 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-12 06:03:23,002 DEBUG [M:0;jenkins-hbase4:32905] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63c26790, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 06:03:23,002 INFO [M:0;jenkins-hbase4:32905] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,32905,1676181799655 2023-02-12 06:03:23,002 INFO [M:0;jenkins-hbase4:32905] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,32905,1676181799655; all regions closed. 2023-02-12 06:03:23,002 DEBUG [M:0;jenkins-hbase4:32905] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:23,002 DEBUG [M:0;jenkins-hbase4:32905] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-12 06:03:23,002 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-12 06:03:23,002 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676181799887] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676181799887,5,FailOnTimeoutGroup] 2023-02-12 06:03:23,002 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676181799887] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676181799887,5,FailOnTimeoutGroup] 2023-02-12 06:03:23,002 DEBUG [M:0;jenkins-hbase4:32905] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-12 06:03:23,004 INFO [M:0;jenkins-hbase4:32905] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-12 06:03:23,004 INFO [M:0;jenkins-hbase4:32905] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-12 06:03:23,004 INFO [M:0;jenkins-hbase4:32905] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-12 06:03:23,004 DEBUG [M:0;jenkins-hbase4:32905] master.HMaster(1502): Stopping service threads 2023-02-12 06:03:23,004 INFO [M:0;jenkins-hbase4:32905] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-12 06:03:23,005 ERROR [M:0;jenkins-hbase4:32905] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-12 06:03:23,005 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-12 06:03:23,005 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:23,005 INFO [M:0;jenkins-hbase4:32905] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-12 06:03:23,005 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-12 06:03:23,005 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 06:03:23,005 DEBUG [M:0;jenkins-hbase4:32905] zookeeper.ZKUtil(398): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-12 06:03:23,005 WARN [M:0;jenkins-hbase4:32905] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-12 06:03:23,005 INFO [M:0;jenkins-hbase4:32905] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-12 06:03:23,006 INFO [M:0;jenkins-hbase4:32905] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-12 06:03:23,006 DEBUG [M:0;jenkins-hbase4:32905] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 06:03:23,006 INFO [M:0;jenkins-hbase4:32905] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:23,006 DEBUG [M:0;jenkins-hbase4:32905] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:23,006 DEBUG [M:0;jenkins-hbase4:32905] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 06:03:23,006 DEBUG [M:0;jenkins-hbase4:32905] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:23,006 INFO [M:0;jenkins-hbase4:32905] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.10 KB heapSize=67.06 KB 2023-02-12 06:03:23,016 INFO [M:0;jenkins-hbase4:32905] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.10 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/3f9e060be0a043898b804e9c9c6e3c6a 2023-02-12 06:03:23,020 DEBUG [M:0;jenkins-hbase4:32905] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/3f9e060be0a043898b804e9c9c6e3c6a as hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/3f9e060be0a043898b804e9c9c6e3c6a 2023-02-12 06:03:23,023 INFO [M:0;jenkins-hbase4:32905] regionserver.HStore(1080): Added hdfs://localhost:35673/user/jenkins/test-data/0c006fa0-3a15-08e6-21a1-2b705fac6944/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/3f9e060be0a043898b804e9c9c6e3c6a, entries=17, sequenceid=132, filesize=8.7 K 2023-02-12 06:03:23,024 INFO [M:0;jenkins-hbase4:32905] regionserver.HRegion(2947): Finished flush of dataSize ~56.10 KB/57443, heapSize ~67.05 KB/68656, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false 2023-02-12 06:03:23,025 INFO [M:0;jenkins-hbase4:32905] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:23,025 DEBUG [M:0;jenkins-hbase4:32905] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676181803006Disabling compacts and flushes for region at 1676181803006Disabling writes for close at 1676181803006Obtaining lock to block concurrent updates at 1676181803006Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676181803006Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57443, getHeapSize=68656, getOffHeapSize=0, getCellsCount=145 at 1676181803006Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676181803007 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676181803009 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676181803011 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676181803011Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676181803020 (+9 ms)Finished flush of dataSize ~56.10 KB/57443, heapSize ~67.05 KB/68656, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false at 1676181803024 (+4 ms)Writing region close event to WAL at 1676181803025 (+1 ms)Closed at 1676181803025 2023-02-12 06:03:23,027 INFO [M:0;jenkins-hbase4:32905] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-12 06:03:23,027 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 06:03:23,028 INFO [M:0;jenkins-hbase4:32905] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:32905 2023-02-12 06:03:23,030 DEBUG [M:0;jenkins-hbase4:32905] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,32905,1676181799655 already deleted, retry=false 2023-02-12 06:03:23,381 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:03:23,381 INFO [M:0;jenkins-hbase4:32905] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,32905,1676181799655; zookeeper connection closed. 2023-02-12 06:03:23,381 ERROR [Listener at localhost/46459-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@112e3ed7 rejected from java.util.concurrent.ThreadPoolExecutor@1511a82a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:23,382 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): master:32905-0x10047206c980000, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:03:23,383 ERROR [Listener at localhost/46459-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1b1cea7 rejected from java.util.concurrent.ThreadPoolExecutor@1511a82a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:23,482 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): regionserver:40903-0x10047206c980002, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:03:23,482 INFO [RS:1;jenkins-hbase4:40903] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40903,1676181799737; zookeeper connection closed. 2023-02-12 06:03:23,482 ERROR [Listener at localhost/46459-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5bff87f3 rejected from java.util.concurrent.ThreadPoolExecutor@23fafc6a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:23,484 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3e2172d3] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3e2172d3 2023-02-12 06:03:23,484 DEBUG [Listener at localhost/46459-EventThread] zookeeper.ZKWatcher(600): regionserver:40903-0x10047206c980002, quorum=127.0.0.1:53582, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:03:23,485 ERROR [Listener at localhost/46459-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@233938d6 rejected from java.util.concurrent.ThreadPoolExecutor@23fafc6a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:23,485 INFO [Listener at localhost/46459] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-12 06:03:23,486 WARN [Listener at localhost/46459] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 06:03:23,489 INFO [Listener at localhost/46459] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 06:03:23,592 WARN [BP-1779926331-172.31.14.131-1676181799068 heartbeating to localhost/127.0.0.1:35673] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 06:03:23,593 WARN [BP-1779926331-172.31.14.131-1676181799068 heartbeating to localhost/127.0.0.1:35673] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1779926331-172.31.14.131-1676181799068 (Datanode Uuid f4955237-fe9e-47f4-bb97-ee7a84d82dc9) service to localhost/127.0.0.1:35673 2023-02-12 06:03:23,593 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eeaa41e4-1e8e-b395-e319-cb5bb6b2cf7e/cluster_625104e1-d58b-2d05-4e31-b7c68e58d9d4/dfs/data/data3/current/BP-1779926331-172.31.14.131-1676181799068] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 06:03:23,593 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eeaa41e4-1e8e-b395-e319-cb5bb6b2cf7e/cluster_625104e1-d58b-2d05-4e31-b7c68e58d9d4/dfs/data/data4/current/BP-1779926331-172.31.14.131-1676181799068] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 06:03:23,596 WARN [Listener at localhost/46459] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 06:03:23,601 INFO [Listener at localhost/46459] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 06:03:23,653 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-12 06:03:23,721 WARN [BP-1779926331-172.31.14.131-1676181799068 heartbeating to localhost/127.0.0.1:35673] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 06:03:23,721 WARN [BP-1779926331-172.31.14.131-1676181799068 heartbeating to localhost/127.0.0.1:35673] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1779926331-172.31.14.131-1676181799068 (Datanode Uuid 24844f80-f06f-43c6-858c-12d801cd0972) service to localhost/127.0.0.1:35673 2023-02-12 06:03:23,722 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eeaa41e4-1e8e-b395-e319-cb5bb6b2cf7e/cluster_625104e1-d58b-2d05-4e31-b7c68e58d9d4/dfs/data/data1/current/BP-1779926331-172.31.14.131-1676181799068] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 06:03:23,722 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eeaa41e4-1e8e-b395-e319-cb5bb6b2cf7e/cluster_625104e1-d58b-2d05-4e31-b7c68e58d9d4/dfs/data/data2/current/BP-1779926331-172.31.14.131-1676181799068] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 06:03:23,739 INFO [Listener at localhost/46459] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 06:03:23,759 INFO [Listener at localhost/46459] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-12 06:03:23,789 INFO [Listener at localhost/46459] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-12 06:03:23,802 INFO [Listener at localhost/46459] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=251 (was 231) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost:35673 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:35673 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/46459 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost:35673 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:35673 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/46459.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:35673 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:35673 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,32905,1676181799655)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:35673 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=653 (was 635) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=329 (was 340), ProcessCount=166 (was 166), AvailableMemoryMB=4213 (was 4257) 2023-02-12 06:03:23,813 INFO [Listener at localhost/46459] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=251, OpenFileDescriptor=653, MaxFileDescriptor=60000, SystemLoadAverage=329, ProcessCount=166, AvailableMemoryMB=4213 2023-02-12 06:03:23,828 INFO [Listener at localhost/46459] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eeaa41e4-1e8e-b395-e319-cb5bb6b2cf7e/hadoop.log.dir so I do NOT create it in target/test-data/0b84db20-31ef-af49-185f-b9ab9096ba02 2023-02-12 06:03:23,828 WARN [Listener at localhost/46459] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eeaa41e4-1e8e-b395-e319-cb5bb6b2cf7e/hadoop.log.dir Erasing configuration value by system value. 2023-02-12 06:03:23,828 INFO [Listener at localhost/46459] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eeaa41e4-1e8e-b395-e319-cb5bb6b2cf7e/hadoop.tmp.dir so I do NOT create it in target/test-data/0b84db20-31ef-af49-185f-b9ab9096ba02 2023-02-12 06:03:23,828 WARN [Listener at localhost/46459] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/eeaa41e4-1e8e-b395-e319-cb5bb6b2cf7e/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-12 06:03:23,829 DEBUG [Listener at localhost/46459] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0b84db20-31ef-af49-185f-b9ab9096ba02 2023-02-12 06:03:23,829 INFO [Listener at localhost/46459] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-12 06:03:23,829 INFO [Listener at localhost/46459] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0b84db20-31ef-af49-185f-b9ab9096ba02/cluster_954cce17-fa99-96fa-d88b-a3ec57b22c1c, deleteOnExit=true 2023-02-12 06:03:23,829 INFO [Listener at localhost/46459] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-12 06:03:23,829 INFO [Listener at localhost/46459] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0b84db20-31ef-af49-185f-b9ab9096ba02/test.cache.data in system properties and HBase conf 2023-02-12 06:03:23,829 INFO [Listener at localhost/46459] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0b84db20-31ef-af49-185f-b9ab9096ba02/hadoop.tmp.dir in system properties and HBase conf 2023-02-12 06:03:23,830 INFO [Listener at localhost/46459] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0b84db20-31ef-af49-185f-b9ab9096ba02/hadoop.log.dir in system properties and HBase conf 2023-02-12 06:03:23,830 INFO [Listener at localhost/46459] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0b84db20-31ef-af49-185f-b9ab9096ba02/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-12 06:03:23,830 INFO [Listener at localhost/46459] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0b84db20-31ef-af49-185f-b9ab9096ba02/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-12 06:03:23,830 INFO [Listener at localhost/46459] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-12 06:03:23,830 DEBUG [Listener at localhost/46459] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-12 06:03:23,830 INFO [Listener at localhost/46459] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0b84db20-31ef-af49-185f-b9ab9096ba02/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-12 06:03:23,831 INFO [Listener at localhost/46459] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0b84db20-31ef-af49-185f-b9ab9096ba02/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-12 06:03:23,831 INFO [Listener at localhost/46459] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0b84db20-31ef-af49-185f-b9ab9096ba02/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-12 06:03:23,831 INFO [Listener at localhost/46459] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0b84db20-31ef-af49-185f-b9ab9096ba02/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 06:03:23,831 INFO [Listener at localhost/46459] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0b84db20-31ef-af49-185f-b9ab9096ba02/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-12 06:03:23,831 INFO [Listener at localhost/46459] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0b84db20-31ef-af49-185f-b9ab9096ba02/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-12 06:03:23,831 INFO [Listener at localhost/46459] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0b84db20-31ef-af49-185f-b9ab9096ba02/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 06:03:23,832 INFO [Listener at localhost/46459] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0b84db20-31ef-af49-185f-b9ab9096ba02/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 06:03:23,832 INFO [Listener at localhost/46459] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0b84db20-31ef-af49-185f-b9ab9096ba02/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-12 06:03:23,832 INFO [Listener at localhost/46459] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0b84db20-31ef-af49-185f-b9ab9096ba02/nfs.dump.dir in system properties and HBase conf 2023-02-12 06:03:23,832 INFO [Listener at localhost/46459] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0b84db20-31ef-af49-185f-b9ab9096ba02/java.io.tmpdir in system properties and HBase conf 2023-02-12 06:03:23,832 INFO [Listener at localhost/46459] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0b84db20-31ef-af49-185f-b9ab9096ba02/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 06:03:23,832 INFO [Listener at localhost/46459] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0b84db20-31ef-af49-185f-b9ab9096ba02/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-12 06:03:23,833 INFO [Listener at localhost/46459] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0b84db20-31ef-af49-185f-b9ab9096ba02/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-12 06:03:23,838 WARN [Listener at localhost/46459] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 06:03:23,838 WARN [Listener at localhost/46459] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 06:03:23,889 WARN [Listener at localhost/46459] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 06:03:23,891 INFO [Listener at localhost/46459] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 06:03:23,899 INFO [Listener at localhost/46459] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0b84db20-31ef-af49-185f-b9ab9096ba02/java.io.tmpdir/Jetty_localhost_39263_hdfs____.symbd9/webapp 2023-02-12 06:03:23,993 INFO [Listener at localhost/46459] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39263 2023-02-12 06:03:23,998 WARN [Listener at localhost/46459] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 06:03:23,998 WARN [Listener at localhost/46459] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 06:03:24,043 WARN [Listener at localhost/35831] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 06:03:24,062 WARN [Listener at localhost/35831] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 06:03:24,064 WARN [Listener at localhost/35831] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 06:03:24,065 INFO [Listener at localhost/35831] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 06:03:24,071 INFO [Listener at localhost/35831] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0b84db20-31ef-af49-185f-b9ab9096ba02/java.io.tmpdir/Jetty_localhost_33945_datanode____.9y6ygv/webapp 2023-02-12 06:03:24,176 INFO [Listener at localhost/35831] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33945 2023-02-12 06:03:24,188 WARN [Listener at localhost/46557] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 06:03:24,213 WARN [Listener at localhost/46557] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 06:03:24,216 WARN [Listener at localhost/46557] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 06:03:24,217 INFO [Listener at localhost/46557] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 06:03:24,227 INFO [Listener at localhost/46557] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0b84db20-31ef-af49-185f-b9ab9096ba02/java.io.tmpdir/Jetty_localhost_44203_datanode____eo92u4/webapp 2023-02-12 06:03:24,342 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x88076a539c10a11e: Processing first storage report for DS-142a58b4-86e6-4ba9-85c1-89ff92d57b78 from datanode c25dd0d9-d2b6-414e-a83e-f28ff10807b3 2023-02-12 06:03:24,342 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x88076a539c10a11e: from storage DS-142a58b4-86e6-4ba9-85c1-89ff92d57b78 node DatanodeRegistration(127.0.0.1:39525, datanodeUuid=c25dd0d9-d2b6-414e-a83e-f28ff10807b3, infoPort=46401, infoSecurePort=0, ipcPort=46557, storageInfo=lv=-57;cid=testClusterID;nsid=1999839430;c=1676181803841), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 06:03:24,342 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x88076a539c10a11e: Processing first storage report for DS-011fa777-707b-4dd0-96da-e1f4f9f8b8e8 from datanode c25dd0d9-d2b6-414e-a83e-f28ff10807b3 2023-02-12 06:03:24,342 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x88076a539c10a11e: from storage DS-011fa777-707b-4dd0-96da-e1f4f9f8b8e8 node DatanodeRegistration(127.0.0.1:39525, datanodeUuid=c25dd0d9-d2b6-414e-a83e-f28ff10807b3, infoPort=46401, infoSecurePort=0, ipcPort=46557, storageInfo=lv=-57;cid=testClusterID;nsid=1999839430;c=1676181803841), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 06:03:24,359 INFO [Listener at localhost/46557] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44203 2023-02-12 06:03:24,369 WARN [Listener at localhost/44093] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 06:03:24,476 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe0a667ce2d311d8f: Processing first storage report for DS-94f6c1d0-c685-4562-af61-bf3d1668b795 from datanode d1237b50-076c-46de-8586-dc6f127b9b24 2023-02-12 06:03:24,477 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe0a667ce2d311d8f: from storage DS-94f6c1d0-c685-4562-af61-bf3d1668b795 node DatanodeRegistration(127.0.0.1:37363, datanodeUuid=d1237b50-076c-46de-8586-dc6f127b9b24, infoPort=37237, infoSecurePort=0, ipcPort=44093, storageInfo=lv=-57;cid=testClusterID;nsid=1999839430;c=1676181803841), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 06:03:24,477 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe0a667ce2d311d8f: Processing first storage report for DS-877d78c5-78bf-4489-8d58-5f30d3a52a33 from datanode d1237b50-076c-46de-8586-dc6f127b9b24 2023-02-12 06:03:24,477 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe0a667ce2d311d8f: from storage DS-877d78c5-78bf-4489-8d58-5f30d3a52a33 node DatanodeRegistration(127.0.0.1:37363, datanodeUuid=d1237b50-076c-46de-8586-dc6f127b9b24, infoPort=37237, infoSecurePort=0, ipcPort=44093, storageInfo=lv=-57;cid=testClusterID;nsid=1999839430;c=1676181803841), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 06:03:24,485 DEBUG [Listener at localhost/44093] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0b84db20-31ef-af49-185f-b9ab9096ba02 2023-02-12 06:03:24,487 INFO [Listener at localhost/44093] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0b84db20-31ef-af49-185f-b9ab9096ba02/cluster_954cce17-fa99-96fa-d88b-a3ec57b22c1c/zookeeper_0, clientPort=64834, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0b84db20-31ef-af49-185f-b9ab9096ba02/cluster_954cce17-fa99-96fa-d88b-a3ec57b22c1c/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0b84db20-31ef-af49-185f-b9ab9096ba02/cluster_954cce17-fa99-96fa-d88b-a3ec57b22c1c/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-12 06:03:24,488 INFO [Listener at localhost/44093] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64834 2023-02-12 06:03:24,488 INFO [Listener at localhost/44093] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:24,489 INFO [Listener at localhost/44093] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:24,503 INFO [Listener at localhost/44093] util.FSUtils(479): Created version file at hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d with version=8 2023-02-12 06:03:24,503 INFO [Listener at localhost/44093] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:24,504 INFO [Listener at localhost/44093] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:24,505 INFO [Listener at localhost/44093] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35831/user/jenkins/test-data/3e31b4e3-6a8e-718d-3e31-85ab63258e32/hbase-staging 2023-02-12 06:03:24,507 INFO [Listener at localhost/44093] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 06:03:24,507 INFO [Listener at localhost/44093] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:24,507 INFO [Listener at localhost/44093] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:24,507 INFO [Listener at localhost/44093] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 06:03:24,508 INFO [Listener at localhost/44093] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:24,508 INFO [Listener at localhost/44093] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 06:03:24,508 INFO [Listener at localhost/44093] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 06:03:24,509 INFO [Listener at localhost/44093] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35999 2023-02-12 06:03:24,509 INFO [Listener at localhost/44093] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:24,510 INFO [Listener at localhost/44093] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:24,511 INFO [Listener at localhost/44093] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35999 connecting to ZooKeeper ensemble=127.0.0.1:64834 2023-02-12 06:03:24,520 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:359990x0, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 06:03:24,523 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:35999-0x10047207f8b0000 connected 2023-02-12 06:03:24,542 DEBUG [Listener at localhost/44093] zookeeper.ZKUtil(164): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 06:03:24,543 DEBUG [Listener at localhost/44093] zookeeper.ZKUtil(164): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:03:24,543 DEBUG [Listener at localhost/44093] zookeeper.ZKUtil(164): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 06:03:24,543 DEBUG [Listener at localhost/44093] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35999 2023-02-12 06:03:24,544 DEBUG [Listener at localhost/44093] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35999 2023-02-12 06:03:24,544 DEBUG [Listener at localhost/44093] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35999 2023-02-12 06:03:24,549 DEBUG [Listener at localhost/44093] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35999 2023-02-12 06:03:24,549 DEBUG [Listener at localhost/44093] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35999 2023-02-12 06:03:24,549 INFO [Listener at localhost/44093] master.HMaster(439): hbase.rootdir=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d, hbase.cluster.distributed=false 2023-02-12 06:03:24,567 INFO [Listener at localhost/44093] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 06:03:24,567 INFO [Listener at localhost/44093] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:24,567 INFO [Listener at localhost/44093] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:24,567 INFO [Listener at localhost/44093] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 06:03:24,567 INFO [Listener at localhost/44093] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:24,568 INFO [Listener at localhost/44093] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 06:03:24,568 INFO [Listener at localhost/44093] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 06:03:24,568 INFO [Listener at localhost/44093] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41805 2023-02-12 06:03:24,569 INFO [Listener at localhost/44093] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 06:03:24,569 DEBUG [Listener at localhost/44093] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:03:24,570 INFO [Listener at localhost/44093] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:24,571 INFO [Listener at localhost/44093] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:24,572 INFO [Listener at localhost/44093] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41805 connecting to ZooKeeper ensemble=127.0.0.1:64834 2023-02-12 06:03:24,574 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): regionserver:418050x0, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 06:03:24,575 DEBUG [Listener at localhost/44093] zookeeper.ZKUtil(164): regionserver:418050x0, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 06:03:24,575 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41805-0x10047207f8b0001 connected 2023-02-12 06:03:24,576 DEBUG [Listener at localhost/44093] zookeeper.ZKUtil(164): regionserver:41805-0x10047207f8b0001, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:03:24,576 DEBUG [Listener at localhost/44093] zookeeper.ZKUtil(164): regionserver:41805-0x10047207f8b0001, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 06:03:24,577 DEBUG [Listener at localhost/44093] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41805 2023-02-12 06:03:24,577 DEBUG [Listener at localhost/44093] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41805 2023-02-12 06:03:24,577 DEBUG [Listener at localhost/44093] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41805 2023-02-12 06:03:24,577 DEBUG [Listener at localhost/44093] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41805 2023-02-12 06:03:24,577 DEBUG [Listener at localhost/44093] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41805 2023-02-12 06:03:24,589 INFO [Listener at localhost/44093] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 06:03:24,589 INFO [Listener at localhost/44093] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:24,589 INFO [Listener at localhost/44093] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:24,589 INFO [Listener at localhost/44093] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 06:03:24,589 INFO [Listener at localhost/44093] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:24,589 INFO [Listener at localhost/44093] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 06:03:24,589 INFO [Listener at localhost/44093] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 06:03:24,590 INFO [Listener at localhost/44093] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35839 2023-02-12 06:03:24,590 INFO [Listener at localhost/44093] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 06:03:24,591 DEBUG [Listener at localhost/44093] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:03:24,591 INFO [Listener at localhost/44093] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:24,592 INFO [Listener at localhost/44093] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:24,593 INFO [Listener at localhost/44093] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35839 connecting to ZooKeeper ensemble=127.0.0.1:64834 2023-02-12 06:03:24,596 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): regionserver:358390x0, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 06:03:24,596 DEBUG [Listener at localhost/44093] zookeeper.ZKUtil(164): regionserver:358390x0, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 06:03:24,597 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:35839-0x10047207f8b0002 connected 2023-02-12 06:03:24,597 DEBUG [Listener at localhost/44093] zookeeper.ZKUtil(164): regionserver:35839-0x10047207f8b0002, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:03:24,598 DEBUG [Listener at localhost/44093] zookeeper.ZKUtil(164): regionserver:35839-0x10047207f8b0002, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 06:03:24,598 DEBUG [Listener at localhost/44093] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35839 2023-02-12 06:03:24,598 DEBUG [Listener at localhost/44093] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35839 2023-02-12 06:03:24,598 DEBUG [Listener at localhost/44093] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35839 2023-02-12 06:03:24,599 DEBUG [Listener at localhost/44093] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35839 2023-02-12 06:03:24,599 DEBUG [Listener at localhost/44093] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35839 2023-02-12 06:03:24,600 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,35999,1676181804506 2023-02-12 06:03:24,602 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 06:03:24,602 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,35999,1676181804506 2023-02-12 06:03:24,603 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): regionserver:41805-0x10047207f8b0001, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 06:03:24,603 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): regionserver:35839-0x10047207f8b0002, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 06:03:24,603 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 06:03:24,604 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:24,606 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 06:03:24,607 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,35999,1676181804506 from backup master directory 2023-02-12 06:03:24,607 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 06:03:24,608 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,35999,1676181804506 2023-02-12 06:03:24,608 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 06:03:24,608 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 06:03:24,608 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,35999,1676181804506 2023-02-12 06:03:24,618 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/hbase.id with ID: 077bd64c-f8ae-471f-8195-f840e4ab4c55 2023-02-12 06:03:24,630 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:24,633 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:24,639 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x35dc9f71 to 127.0.0.1:64834 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 06:03:24,642 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4fa80258, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 06:03:24,642 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 06:03:24,642 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-12 06:03:24,643 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 06:03:24,644 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/MasterData/data/master/store-tmp 2023-02-12 06:03:24,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:24,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 06:03:24,650 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:24,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:24,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 06:03:24,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:24,650 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:24,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676181804650Disabling compacts and flushes for region at 1676181804650Disabling writes for close at 1676181804650Writing region close event to WAL at 1676181804650Closed at 1676181804650 2023-02-12 06:03:24,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/MasterData/WALs/jenkins-hbase4.apache.org,35999,1676181804506 2023-02-12 06:03:24,657 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35999%2C1676181804506, suffix=, logDir=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/MasterData/WALs/jenkins-hbase4.apache.org,35999,1676181804506, archiveDir=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/MasterData/oldWALs, maxLogs=10 2023-02-12 06:03:24,674 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39525,DS-142a58b4-86e6-4ba9-85c1-89ff92d57b78,DISK] 2023-02-12 06:03:24,674 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37363,DS-94f6c1d0-c685-4562-af61-bf3d1668b795,DISK] 2023-02-12 06:03:24,676 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/MasterData/WALs/jenkins-hbase4.apache.org,35999,1676181804506/jenkins-hbase4.apache.org%2C35999%2C1676181804506.1676181804657 2023-02-12 06:03:24,676 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39525,DS-142a58b4-86e6-4ba9-85c1-89ff92d57b78,DISK], DatanodeInfoWithStorage[127.0.0.1:37363,DS-94f6c1d0-c685-4562-af61-bf3d1668b795,DISK]] 2023-02-12 06:03:24,676 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-12 06:03:24,677 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:24,677 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:03:24,677 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:03:24,678 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:03:24,679 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-12 06:03:24,679 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-12 06:03:24,679 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:24,680 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:03:24,680 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:03:24,682 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:03:24,684 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:03:24,684 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73772267, jitterRate=0.09929244220256805}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 06:03:24,684 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676181804677Initializing all the Stores at 1676181804677Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181804677Cleaning up temporary data from old regions at 1676181804681 (+4 ms)Cleaning up detritus from prior splits at 1676181804681Region opened successfully at 1676181804684 (+3 ms) 2023-02-12 06:03:24,684 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-12 06:03:24,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-12 06:03:24,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-12 06:03:24,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-12 06:03:24,686 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-12 06:03:24,686 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-12 06:03:24,686 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-12 06:03:24,687 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-12 06:03:24,687 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-12 06:03:24,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-12 06:03:24,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-12 06:03:24,701 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-12 06:03:24,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-12 06:03:24,702 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-12 06:03:24,704 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:24,704 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-12 06:03:24,704 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-12 06:03:24,705 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-12 06:03:24,707 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): regionserver:41805-0x10047207f8b0001, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 06:03:24,707 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 06:03:24,707 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:24,707 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): regionserver:35839-0x10047207f8b0002, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 06:03:24,707 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,35999,1676181804506, sessionid=0x10047207f8b0000, setting cluster-up flag (Was=false) 2023-02-12 06:03:24,714 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:24,719 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-12 06:03:24,720 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35999,1676181804506 2023-02-12 06:03:24,723 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:24,727 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-12 06:03:24,728 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35999,1676181804506 2023-02-12 06:03:24,729 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/.hbase-snapshot/.tmp 2023-02-12 06:03:24,730 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-12 06:03:24,730 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 06:03:24,730 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 06:03:24,730 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 06:03:24,730 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 06:03:24,730 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-12 06:03:24,731 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:24,731 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 06:03:24,731 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:24,736 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676181834736 2023-02-12 06:03:24,737 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-12 06:03:24,737 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-12 06:03:24,737 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 06:03:24,737 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-12 06:03:24,737 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-12 06:03:24,737 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-12 06:03:24,737 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-12 06:03:24,737 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-12 06:03:24,737 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:24,737 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-12 06:03:24,738 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-12 06:03:24,738 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-12 06:03:24,738 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-12 06:03:24,738 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 06:03:24,738 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-12 06:03:24,739 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676181804738,5,FailOnTimeoutGroup] 2023-02-12 06:03:24,739 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676181804739,5,FailOnTimeoutGroup] 2023-02-12 06:03:24,739 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:24,739 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-12 06:03:24,739 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:24,739 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:24,747 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 06:03:24,747 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 06:03:24,747 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d 2023-02-12 06:03:24,753 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:24,754 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 06:03:24,756 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/hbase/meta/1588230740/info 2023-02-12 06:03:24,756 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 06:03:24,756 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:24,757 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 06:03:24,758 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/hbase/meta/1588230740/rep_barrier 2023-02-12 06:03:24,758 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 06:03:24,758 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:24,758 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 06:03:24,759 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/hbase/meta/1588230740/table 2023-02-12 06:03:24,760 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 06:03:24,760 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:24,760 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/hbase/meta/1588230740 2023-02-12 06:03:24,761 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/hbase/meta/1588230740 2023-02-12 06:03:24,767 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 06:03:24,769 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 06:03:24,772 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:03:24,772 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59798512, jitterRate=-0.1089327335357666}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 06:03:24,772 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676181804753Initializing all the Stores at 1676181804754 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676181804754Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181804754Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676181804754Cleaning up temporary data from old regions at 1676181804762 (+8 ms)Cleaning up detritus from prior splits at 1676181804764 (+2 ms)Region opened successfully at 1676181804772 (+8 ms) 2023-02-12 06:03:24,772 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 06:03:24,772 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 06:03:24,772 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 06:03:24,773 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 06:03:24,773 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 06:03:24,773 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 06:03:24,773 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676181804772Disabling compacts and flushes for region at 1676181804772Disabling writes for close at 1676181804773 (+1 ms)Writing region close event to WAL at 1676181804773Closed at 1676181804773 2023-02-12 06:03:24,774 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 06:03:24,774 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-12 06:03:24,774 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-12 06:03:24,775 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-12 06:03:24,777 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-12 06:03:24,801 INFO [RS:1;jenkins-hbase4:35839] regionserver.HRegionServer(952): ClusterId : 077bd64c-f8ae-471f-8195-f840e4ab4c55 2023-02-12 06:03:24,801 INFO [RS:0;jenkins-hbase4:41805] regionserver.HRegionServer(952): ClusterId : 077bd64c-f8ae-471f-8195-f840e4ab4c55 2023-02-12 06:03:24,801 DEBUG [RS:1;jenkins-hbase4:35839] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 06:03:24,801 DEBUG [RS:0;jenkins-hbase4:41805] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 06:03:24,803 DEBUG [RS:1;jenkins-hbase4:35839] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 06:03:24,804 DEBUG [RS:0;jenkins-hbase4:41805] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 06:03:24,804 DEBUG [RS:0;jenkins-hbase4:41805] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 06:03:24,804 DEBUG [RS:1;jenkins-hbase4:35839] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 06:03:24,806 DEBUG [RS:1;jenkins-hbase4:35839] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 06:03:24,806 DEBUG [RS:0;jenkins-hbase4:41805] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 06:03:24,807 DEBUG [RS:0;jenkins-hbase4:41805] zookeeper.ReadOnlyZKClient(139): Connect 0x4bb73a2f to 127.0.0.1:64834 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 06:03:24,807 DEBUG [RS:1;jenkins-hbase4:35839] zookeeper.ReadOnlyZKClient(139): Connect 0x50f9e1c7 to 127.0.0.1:64834 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 06:03:24,811 DEBUG [RS:0;jenkins-hbase4:41805] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4570dd29, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 06:03:24,811 DEBUG [RS:1;jenkins-hbase4:35839] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e3e05a8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 06:03:24,811 DEBUG [RS:0;jenkins-hbase4:41805] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@414f515f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 06:03:24,811 DEBUG [RS:1;jenkins-hbase4:35839] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a018ab7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 06:03:24,820 DEBUG [RS:1;jenkins-hbase4:35839] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:35839 2023-02-12 06:03:24,820 INFO [RS:1;jenkins-hbase4:35839] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 06:03:24,820 INFO [RS:1;jenkins-hbase4:35839] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 06:03:24,820 DEBUG [RS:1;jenkins-hbase4:35839] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 06:03:24,821 INFO [RS:1;jenkins-hbase4:35839] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35999,1676181804506 with isa=jenkins-hbase4.apache.org/172.31.14.131:35839, startcode=1676181804588 2023-02-12 06:03:24,821 DEBUG [RS:1;jenkins-hbase4:35839] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 06:03:24,821 DEBUG [RS:0;jenkins-hbase4:41805] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:41805 2023-02-12 06:03:24,821 INFO [RS:0;jenkins-hbase4:41805] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 06:03:24,821 INFO [RS:0;jenkins-hbase4:41805] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 06:03:24,821 DEBUG [RS:0;jenkins-hbase4:41805] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 06:03:24,822 INFO [RS:0;jenkins-hbase4:41805] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35999,1676181804506 with isa=jenkins-hbase4.apache.org/172.31.14.131:41805, startcode=1676181804566 2023-02-12 06:03:24,822 DEBUG [RS:0;jenkins-hbase4:41805] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 06:03:24,823 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41971, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 06:03:24,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:24,825 DEBUG [RS:1;jenkins-hbase4:35839] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d 2023-02-12 06:03:24,825 DEBUG [RS:1;jenkins-hbase4:35839] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:35831 2023-02-12 06:03:24,825 DEBUG [RS:1;jenkins-hbase4:35839] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 06:03:24,825 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43979, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 06:03:24,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41805,1676181804566 2023-02-12 06:03:24,826 DEBUG [RS:0;jenkins-hbase4:41805] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d 2023-02-12 06:03:24,826 DEBUG [RS:0;jenkins-hbase4:41805] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:35831 2023-02-12 06:03:24,826 DEBUG [RS:0;jenkins-hbase4:41805] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 06:03:24,826 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 06:03:24,830 DEBUG [RS:1;jenkins-hbase4:35839] zookeeper.ZKUtil(162): regionserver:35839-0x10047207f8b0002, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:24,830 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41805,1676181804566] 2023-02-12 06:03:24,830 WARN [RS:1;jenkins-hbase4:35839] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 06:03:24,830 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35839,1676181804588] 2023-02-12 06:03:24,830 INFO [RS:1;jenkins-hbase4:35839] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 06:03:24,831 DEBUG [RS:0;jenkins-hbase4:41805] zookeeper.ZKUtil(162): regionserver:41805-0x10047207f8b0001, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41805,1676181804566 2023-02-12 06:03:24,831 DEBUG [RS:1;jenkins-hbase4:35839] regionserver.HRegionServer(1947): logDir=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/WALs/jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:24,831 WARN [RS:0;jenkins-hbase4:41805] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 06:03:24,831 INFO [RS:0;jenkins-hbase4:41805] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 06:03:24,831 DEBUG [RS:0;jenkins-hbase4:41805] regionserver.HRegionServer(1947): logDir=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/WALs/jenkins-hbase4.apache.org,41805,1676181804566 2023-02-12 06:03:24,835 DEBUG [RS:1;jenkins-hbase4:35839] zookeeper.ZKUtil(162): regionserver:35839-0x10047207f8b0002, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41805,1676181804566 2023-02-12 06:03:24,835 DEBUG [RS:0;jenkins-hbase4:41805] zookeeper.ZKUtil(162): regionserver:41805-0x10047207f8b0001, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41805,1676181804566 2023-02-12 06:03:24,836 DEBUG [RS:1;jenkins-hbase4:35839] zookeeper.ZKUtil(162): regionserver:35839-0x10047207f8b0002, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:24,836 DEBUG [RS:0;jenkins-hbase4:41805] zookeeper.ZKUtil(162): regionserver:41805-0x10047207f8b0001, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:24,836 DEBUG [RS:1;jenkins-hbase4:35839] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 06:03:24,836 DEBUG [RS:0;jenkins-hbase4:41805] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 06:03:24,837 INFO [RS:1;jenkins-hbase4:35839] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 06:03:24,837 INFO [RS:0;jenkins-hbase4:41805] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 06:03:24,838 INFO [RS:1;jenkins-hbase4:35839] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 06:03:24,838 INFO [RS:1;jenkins-hbase4:35839] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 06:03:24,838 INFO [RS:1;jenkins-hbase4:35839] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:24,838 INFO [RS:1;jenkins-hbase4:35839] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 06:03:24,844 INFO [RS:0;jenkins-hbase4:41805] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 06:03:24,844 INFO [RS:1;jenkins-hbase4:35839] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:24,845 INFO [RS:0;jenkins-hbase4:41805] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 06:03:24,845 DEBUG [RS:1;jenkins-hbase4:35839] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:24,845 INFO [RS:0;jenkins-hbase4:41805] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:24,845 DEBUG [RS:1;jenkins-hbase4:35839] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:24,845 DEBUG [RS:1;jenkins-hbase4:35839] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:24,845 DEBUG [RS:1;jenkins-hbase4:35839] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:24,845 DEBUG [RS:1;jenkins-hbase4:35839] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:24,845 DEBUG [RS:1;jenkins-hbase4:35839] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 06:03:24,845 DEBUG [RS:1;jenkins-hbase4:35839] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:24,845 DEBUG [RS:1;jenkins-hbase4:35839] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:24,845 DEBUG [RS:1;jenkins-hbase4:35839] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:24,846 DEBUG [RS:1;jenkins-hbase4:35839] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:24,846 INFO [RS:0;jenkins-hbase4:41805] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 06:03:24,847 INFO [RS:1;jenkins-hbase4:35839] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:24,847 INFO [RS:1;jenkins-hbase4:35839] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:24,848 INFO [RS:1;jenkins-hbase4:35839] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:24,848 INFO [RS:0;jenkins-hbase4:41805] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:24,848 DEBUG [RS:0;jenkins-hbase4:41805] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:24,848 DEBUG [RS:0;jenkins-hbase4:41805] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:24,848 DEBUG [RS:0;jenkins-hbase4:41805] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:24,848 DEBUG [RS:0;jenkins-hbase4:41805] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:24,848 DEBUG [RS:0;jenkins-hbase4:41805] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:24,848 DEBUG [RS:0;jenkins-hbase4:41805] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 06:03:24,848 DEBUG [RS:0;jenkins-hbase4:41805] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:24,848 DEBUG [RS:0;jenkins-hbase4:41805] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:24,849 DEBUG [RS:0;jenkins-hbase4:41805] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:24,849 DEBUG [RS:0;jenkins-hbase4:41805] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:24,850 INFO [RS:0;jenkins-hbase4:41805] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:24,851 INFO [RS:0;jenkins-hbase4:41805] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:24,851 INFO [RS:0;jenkins-hbase4:41805] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:24,862 INFO [RS:1;jenkins-hbase4:35839] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 06:03:24,862 INFO [RS:1;jenkins-hbase4:35839] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35839,1676181804588-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:24,864 INFO [RS:0;jenkins-hbase4:41805] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 06:03:24,865 INFO [RS:0;jenkins-hbase4:41805] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41805,1676181804566-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:24,875 INFO [RS:1;jenkins-hbase4:35839] regionserver.Replication(203): jenkins-hbase4.apache.org,35839,1676181804588 started 2023-02-12 06:03:24,875 INFO [RS:1;jenkins-hbase4:35839] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,35839,1676181804588, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35839, sessionid=0x10047207f8b0002 2023-02-12 06:03:24,875 DEBUG [RS:1;jenkins-hbase4:35839] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 06:03:24,875 DEBUG [RS:1;jenkins-hbase4:35839] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:24,875 DEBUG [RS:1;jenkins-hbase4:35839] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35839,1676181804588' 2023-02-12 06:03:24,875 DEBUG [RS:1;jenkins-hbase4:35839] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:03:24,875 DEBUG [RS:1;jenkins-hbase4:35839] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:03:24,876 DEBUG [RS:1;jenkins-hbase4:35839] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 06:03:24,876 DEBUG [RS:1;jenkins-hbase4:35839] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 06:03:24,876 DEBUG [RS:1;jenkins-hbase4:35839] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:24,876 DEBUG [RS:1;jenkins-hbase4:35839] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35839,1676181804588' 2023-02-12 06:03:24,876 DEBUG [RS:1;jenkins-hbase4:35839] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:03:24,876 DEBUG [RS:1;jenkins-hbase4:35839] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:03:24,877 INFO [RS:0;jenkins-hbase4:41805] regionserver.Replication(203): jenkins-hbase4.apache.org,41805,1676181804566 started 2023-02-12 06:03:24,877 DEBUG [RS:1;jenkins-hbase4:35839] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 06:03:24,877 INFO [RS:0;jenkins-hbase4:41805] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,41805,1676181804566, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41805, sessionid=0x10047207f8b0001 2023-02-12 06:03:24,877 INFO [RS:1;jenkins-hbase4:35839] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 06:03:24,877 INFO [RS:1;jenkins-hbase4:35839] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 06:03:24,877 DEBUG [RS:0;jenkins-hbase4:41805] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 06:03:24,877 DEBUG [RS:0;jenkins-hbase4:41805] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41805,1676181804566 2023-02-12 06:03:24,877 DEBUG [RS:0;jenkins-hbase4:41805] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41805,1676181804566' 2023-02-12 06:03:24,877 DEBUG [RS:0;jenkins-hbase4:41805] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:03:24,877 DEBUG [RS:0;jenkins-hbase4:41805] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:03:24,878 DEBUG [RS:0;jenkins-hbase4:41805] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 06:03:24,878 DEBUG [RS:0;jenkins-hbase4:41805] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 06:03:24,878 DEBUG [RS:0;jenkins-hbase4:41805] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41805,1676181804566 2023-02-12 06:03:24,878 DEBUG [RS:0;jenkins-hbase4:41805] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41805,1676181804566' 2023-02-12 06:03:24,878 DEBUG [RS:0;jenkins-hbase4:41805] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:03:24,878 DEBUG [RS:0;jenkins-hbase4:41805] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:03:24,878 DEBUG [RS:0;jenkins-hbase4:41805] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 06:03:24,878 INFO [RS:0;jenkins-hbase4:41805] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 06:03:24,878 INFO [RS:0;jenkins-hbase4:41805] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 06:03:24,927 DEBUG [jenkins-hbase4:35999] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-12 06:03:24,927 DEBUG [jenkins-hbase4:35999] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 06:03:24,929 DEBUG [jenkins-hbase4:35999] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 06:03:24,929 DEBUG [jenkins-hbase4:35999] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 06:03:24,929 DEBUG [jenkins-hbase4:35999] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 06:03:24,929 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41805,1676181804566, state=OPENING 2023-02-12 06:03:24,935 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-12 06:03:24,936 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:24,937 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 06:03:24,937 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41805,1676181804566}] 2023-02-12 06:03:25,094 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41805,1676181804566 2023-02-12 06:03:25,094 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 06:03:25,096 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47974, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 06:03:25,101 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-12 06:03:25,101 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 06:03:25,102 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41805%2C1676181804566.meta, suffix=.meta, logDir=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/WALs/jenkins-hbase4.apache.org,41805,1676181804566, archiveDir=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/oldWALs, maxLogs=32 2023-02-12 06:03:25,116 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37363,DS-94f6c1d0-c685-4562-af61-bf3d1668b795,DISK] 2023-02-12 06:03:25,116 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39525,DS-142a58b4-86e6-4ba9-85c1-89ff92d57b78,DISK] 2023-02-12 06:03:25,118 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/WALs/jenkins-hbase4.apache.org,41805,1676181804566/jenkins-hbase4.apache.org%2C41805%2C1676181804566.meta.1676181805103.meta 2023-02-12 06:03:25,118 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37363,DS-94f6c1d0-c685-4562-af61-bf3d1668b795,DISK], DatanodeInfoWithStorage[127.0.0.1:39525,DS-142a58b4-86e6-4ba9-85c1-89ff92d57b78,DISK]] 2023-02-12 06:03:25,119 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-12 06:03:25,119 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-12 06:03:25,119 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-12 06:03:25,119 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-12 06:03:25,119 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-12 06:03:25,119 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:25,119 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-12 06:03:25,119 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-12 06:03:25,120 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 06:03:25,121 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/hbase/meta/1588230740/info 2023-02-12 06:03:25,121 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/hbase/meta/1588230740/info 2023-02-12 06:03:25,122 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 06:03:25,122 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:25,122 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 06:03:25,123 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/hbase/meta/1588230740/rep_barrier 2023-02-12 06:03:25,123 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/hbase/meta/1588230740/rep_barrier 2023-02-12 06:03:25,123 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 06:03:25,124 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:25,124 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 06:03:25,124 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/hbase/meta/1588230740/table 2023-02-12 06:03:25,124 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/hbase/meta/1588230740/table 2023-02-12 06:03:25,124 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 06:03:25,125 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:25,125 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/hbase/meta/1588230740 2023-02-12 06:03:25,126 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/hbase/meta/1588230740 2023-02-12 06:03:25,128 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 06:03:25,129 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 06:03:25,130 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64280702, jitterRate=-0.042142897844314575}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 06:03:25,130 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676181805119Writing region info on filesystem at 1676181805119Initializing all the Stores at 1676181805120 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676181805120Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181805120Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676181805120Cleaning up temporary data from old regions at 1676181805127 (+7 ms)Cleaning up detritus from prior splits at 1676181805128 (+1 ms)Running coprocessor post-open hooks at 1676181805130 (+2 ms)Region opened successfully at 1676181805130 2023-02-12 06:03:25,130 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676181805094 2023-02-12 06:03:25,137 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-12 06:03:25,138 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-12 06:03:25,138 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41805,1676181804566, state=OPEN 2023-02-12 06:03:25,139 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-12 06:03:25,139 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 06:03:25,140 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-12 06:03:25,140 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41805,1676181804566 in 202 msec 2023-02-12 06:03:25,141 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-12 06:03:25,142 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 366 msec 2023-02-12 06:03:25,143 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 413 msec 2023-02-12 06:03:25,143 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676181804602, completionTime=-1 2023-02-12 06:03:25,143 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-12 06:03:25,143 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-12 06:03:25,144 DEBUG [hconnection-0x3823f9f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 06:03:25,145 INFO [RS-EventLoopGroup-19-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47984, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 06:03:25,147 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-12 06:03:25,147 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676181865147 2023-02-12 06:03:25,147 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676181925147 2023-02-12 06:03:25,147 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-12 06:03:25,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35999,1676181804506-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:25,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35999,1676181804506-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:25,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35999,1676181804506-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:25,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:35999, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:25,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:25,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-12 06:03:25,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 06:03:25,158 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-12 06:03:25,159 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-12 06:03:25,159 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 06:03:25,160 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 06:03:25,161 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/.tmp/data/hbase/namespace/7feb1b58d0a981cd65359ae54665b538 2023-02-12 06:03:25,162 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/.tmp/data/hbase/namespace/7feb1b58d0a981cd65359ae54665b538 empty. 2023-02-12 06:03:25,162 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/.tmp/data/hbase/namespace/7feb1b58d0a981cd65359ae54665b538 2023-02-12 06:03:25,162 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-12 06:03:25,175 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-12 06:03:25,176 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7feb1b58d0a981cd65359ae54665b538, NAME => 'hbase:namespace,,1676181805157.7feb1b58d0a981cd65359ae54665b538.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/.tmp 2023-02-12 06:03:25,186 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676181805157.7feb1b58d0a981cd65359ae54665b538.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:25,186 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 7feb1b58d0a981cd65359ae54665b538, disabling compactions & flushes 2023-02-12 06:03:25,186 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676181805157.7feb1b58d0a981cd65359ae54665b538. 2023-02-12 06:03:25,186 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676181805157.7feb1b58d0a981cd65359ae54665b538. 2023-02-12 06:03:25,186 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676181805157.7feb1b58d0a981cd65359ae54665b538. after waiting 0 ms 2023-02-12 06:03:25,186 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676181805157.7feb1b58d0a981cd65359ae54665b538. 2023-02-12 06:03:25,186 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676181805157.7feb1b58d0a981cd65359ae54665b538. 2023-02-12 06:03:25,186 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 7feb1b58d0a981cd65359ae54665b538: Waiting for close lock at 1676181805186Disabling compacts and flushes for region at 1676181805186Disabling writes for close at 1676181805186Writing region close event to WAL at 1676181805186Closed at 1676181805186 2023-02-12 06:03:25,188 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 06:03:25,190 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676181805157.7feb1b58d0a981cd65359ae54665b538.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676181805189"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181805189"}]},"ts":"1676181805189"} 2023-02-12 06:03:25,191 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 06:03:25,191 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 06:03:25,192 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676181805192"}]},"ts":"1676181805192"} 2023-02-12 06:03:25,193 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-12 06:03:25,196 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 06:03:25,196 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 06:03:25,197 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 06:03:25,197 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 06:03:25,197 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7feb1b58d0a981cd65359ae54665b538, ASSIGN}] 2023-02-12 06:03:25,199 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7feb1b58d0a981cd65359ae54665b538, ASSIGN 2023-02-12 06:03:25,200 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=7feb1b58d0a981cd65359ae54665b538, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41805,1676181804566; forceNewPlan=false, retain=false 2023-02-12 06:03:25,350 INFO [jenkins-hbase4:35999] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 06:03:25,350 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7feb1b58d0a981cd65359ae54665b538, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41805,1676181804566 2023-02-12 06:03:25,350 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676181805157.7feb1b58d0a981cd65359ae54665b538.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676181805350"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181805350"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181805350"}]},"ts":"1676181805350"} 2023-02-12 06:03:25,352 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 7feb1b58d0a981cd65359ae54665b538, server=jenkins-hbase4.apache.org,41805,1676181804566}] 2023-02-12 06:03:25,507 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676181805157.7feb1b58d0a981cd65359ae54665b538. 2023-02-12 06:03:25,509 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41805%2C1676181804566, suffix=, logDir=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/WALs/jenkins-hbase4.apache.org,41805,1676181804566, archiveDir=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/oldWALs, maxLogs=32 2023-02-12 06:03:25,525 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39525,DS-142a58b4-86e6-4ba9-85c1-89ff92d57b78,DISK] 2023-02-12 06:03:25,525 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37363,DS-94f6c1d0-c685-4562-af61-bf3d1668b795,DISK] 2023-02-12 06:03:25,527 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/WALs/jenkins-hbase4.apache.org,41805,1676181804566/jenkins-hbase4.apache.org%2C41805%2C1676181804566.1676181805509 2023-02-12 06:03:25,527 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37363,DS-94f6c1d0-c685-4562-af61-bf3d1668b795,DISK], DatanodeInfoWithStorage[127.0.0.1:39525,DS-142a58b4-86e6-4ba9-85c1-89ff92d57b78,DISK]] 2023-02-12 06:03:25,528 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7feb1b58d0a981cd65359ae54665b538, NAME => 'hbase:namespace,,1676181805157.7feb1b58d0a981cd65359ae54665b538.', STARTKEY => '', ENDKEY => ''} 2023-02-12 06:03:25,528 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 7feb1b58d0a981cd65359ae54665b538 2023-02-12 06:03:25,528 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676181805157.7feb1b58d0a981cd65359ae54665b538.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:25,528 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7feb1b58d0a981cd65359ae54665b538 2023-02-12 06:03:25,528 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7feb1b58d0a981cd65359ae54665b538 2023-02-12 06:03:25,529 INFO [StoreOpener-7feb1b58d0a981cd65359ae54665b538-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 7feb1b58d0a981cd65359ae54665b538 2023-02-12 06:03:25,530 DEBUG [StoreOpener-7feb1b58d0a981cd65359ae54665b538-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/hbase/namespace/7feb1b58d0a981cd65359ae54665b538/info 2023-02-12 06:03:25,530 DEBUG [StoreOpener-7feb1b58d0a981cd65359ae54665b538-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/hbase/namespace/7feb1b58d0a981cd65359ae54665b538/info 2023-02-12 06:03:25,531 INFO [StoreOpener-7feb1b58d0a981cd65359ae54665b538-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7feb1b58d0a981cd65359ae54665b538 columnFamilyName info 2023-02-12 06:03:25,531 INFO [StoreOpener-7feb1b58d0a981cd65359ae54665b538-1] regionserver.HStore(310): Store=7feb1b58d0a981cd65359ae54665b538/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:25,532 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/hbase/namespace/7feb1b58d0a981cd65359ae54665b538 2023-02-12 06:03:25,532 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/hbase/namespace/7feb1b58d0a981cd65359ae54665b538 2023-02-12 06:03:25,534 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7feb1b58d0a981cd65359ae54665b538 2023-02-12 06:03:25,536 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/hbase/namespace/7feb1b58d0a981cd65359ae54665b538/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:03:25,536 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7feb1b58d0a981cd65359ae54665b538; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61646682, jitterRate=-0.08139285445213318}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 06:03:25,536 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7feb1b58d0a981cd65359ae54665b538: Running coprocessor pre-open hook at 1676181805528Writing region info on filesystem at 1676181805528Initializing all the Stores at 1676181805529 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676181805529Cleaning up temporary data from old regions at 1676181805532 (+3 ms)Cleaning up detritus from prior splits at 1676181805533 (+1 ms)Running coprocessor post-open hooks at 1676181805536 (+3 ms)Region opened successfully at 1676181805536 2023-02-12 06:03:25,538 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676181805157.7feb1b58d0a981cd65359ae54665b538., pid=6, masterSystemTime=1676181805504 2023-02-12 06:03:25,541 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676181805157.7feb1b58d0a981cd65359ae54665b538. 2023-02-12 06:03:25,541 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676181805157.7feb1b58d0a981cd65359ae54665b538. 2023-02-12 06:03:25,541 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7feb1b58d0a981cd65359ae54665b538, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41805,1676181804566 2023-02-12 06:03:25,541 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676181805157.7feb1b58d0a981cd65359ae54665b538.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676181805541"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676181805541"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676181805541"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676181805541"}]},"ts":"1676181805541"} 2023-02-12 06:03:25,544 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-12 06:03:25,544 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 7feb1b58d0a981cd65359ae54665b538, server=jenkins-hbase4.apache.org,41805,1676181804566 in 190 msec 2023-02-12 06:03:25,547 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-12 06:03:25,547 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=7feb1b58d0a981cd65359ae54665b538, ASSIGN in 347 msec 2023-02-12 06:03:25,552 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 06:03:25,552 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676181805552"}]},"ts":"1676181805552"} 2023-02-12 06:03:25,553 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-12 06:03:25,556 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 06:03:25,557 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 399 msec 2023-02-12 06:03:25,559 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-12 06:03:25,561 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-12 06:03:25,561 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:25,567 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-12 06:03:25,574 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 06:03:25,577 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-12 06:03:25,588 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-12 06:03:25,594 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 06:03:25,598 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-12 06:03:25,602 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-12 06:03:25,605 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-12 06:03:25,605 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.997sec 2023-02-12 06:03:25,605 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-12 06:03:25,605 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-12 06:03:25,605 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-12 06:03:25,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35999,1676181804506-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-12 06:03:25,606 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35999,1676181804506-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-12 06:03:25,607 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-12 06:03:25,701 DEBUG [Listener at localhost/44093] zookeeper.ReadOnlyZKClient(139): Connect 0x52b2ce3f to 127.0.0.1:64834 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 06:03:25,704 DEBUG [Listener at localhost/44093] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b84e11, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 06:03:25,706 DEBUG [hconnection-0x4a0760be-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 06:03:25,708 INFO [RS-EventLoopGroup-19-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47992, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 06:03:25,709 INFO [Listener at localhost/44093] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,35999,1676181804506 2023-02-12 06:03:25,709 DEBUG [Listener at localhost/44093] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-12 06:03:25,711 DEBUG [Listener at localhost/44093] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 06:03:25,713 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59120, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 06:03:25,714 INFO [Listener at localhost/44093] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:25,714 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:25,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-12 06:03:25,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 103 connection: 172.31.14.131:59120 deadline: 1676181865714, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:25,715 INFO [Listener at localhost/44093] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-12 06:03:25,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 06:03:25,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:25,719 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 06:03:25,719 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-12 06:03:25,720 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 06:03:25,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 06:03:25,721 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde 2023-02-12 06:03:25,721 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde empty. 2023-02-12 06:03:25,722 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde 2023-02-12 06:03:25,722 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-12 06:03:25,743 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-12 06:03:25,744 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => cb73533ba88ac459df56f2094bceddde, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/.tmp 2023-02-12 06:03:25,754 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:25,754 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing cb73533ba88ac459df56f2094bceddde, disabling compactions & flushes 2023-02-12 06:03:25,754 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde. 2023-02-12 06:03:25,754 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde. 2023-02-12 06:03:25,754 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde. after waiting 0 ms 2023-02-12 06:03:25,754 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde. 2023-02-12 06:03:25,754 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde. 2023-02-12 06:03:25,754 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for cb73533ba88ac459df56f2094bceddde: Waiting for close lock at 1676181805754Disabling compacts and flushes for region at 1676181805754Disabling writes for close at 1676181805754Writing region close event to WAL at 1676181805754Closed at 1676181805754 2023-02-12 06:03:25,756 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 06:03:25,757 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676181805757"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181805757"}]},"ts":"1676181805757"} 2023-02-12 06:03:25,759 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 06:03:25,759 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 06:03:25,760 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676181805759"}]},"ts":"1676181805759"} 2023-02-12 06:03:25,761 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-12 06:03:25,763 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 06:03:25,764 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 06:03:25,764 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 06:03:25,764 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 06:03:25,765 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=cb73533ba88ac459df56f2094bceddde, ASSIGN}] 2023-02-12 06:03:25,768 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=cb73533ba88ac459df56f2094bceddde, ASSIGN 2023-02-12 06:03:25,769 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=cb73533ba88ac459df56f2094bceddde, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35839,1676181804588; forceNewPlan=false, retain=false 2023-02-12 06:03:25,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 06:03:25,878 INFO [RS:1;jenkins-hbase4:35839] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35839%2C1676181804588, suffix=, logDir=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/WALs/jenkins-hbase4.apache.org,35839,1676181804588, archiveDir=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/oldWALs, maxLogs=32 2023-02-12 06:03:25,898 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37363,DS-94f6c1d0-c685-4562-af61-bf3d1668b795,DISK] 2023-02-12 06:03:25,898 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39525,DS-142a58b4-86e6-4ba9-85c1-89ff92d57b78,DISK] 2023-02-12 06:03:25,900 INFO [RS:1;jenkins-hbase4:35839] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/WALs/jenkins-hbase4.apache.org,35839,1676181804588/jenkins-hbase4.apache.org%2C35839%2C1676181804588.1676181805879 2023-02-12 06:03:25,901 DEBUG [RS:1;jenkins-hbase4:35839] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37363,DS-94f6c1d0-c685-4562-af61-bf3d1668b795,DISK], DatanodeInfoWithStorage[127.0.0.1:39525,DS-142a58b4-86e6-4ba9-85c1-89ff92d57b78,DISK]] 2023-02-12 06:03:25,919 INFO [jenkins-hbase4:35999] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 06:03:25,919 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=cb73533ba88ac459df56f2094bceddde, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:25,919 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676181805919"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181805919"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181805919"}]},"ts":"1676181805919"} 2023-02-12 06:03:25,921 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure cb73533ba88ac459df56f2094bceddde, server=jenkins-hbase4.apache.org,35839,1676181804588}] 2023-02-12 06:03:26,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 06:03:26,073 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:26,074 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 06:03:26,075 INFO [RS-EventLoopGroup-20-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38896, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 06:03:26,078 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde. 2023-02-12 06:03:26,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => cb73533ba88ac459df56f2094bceddde, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde.', STARTKEY => '', ENDKEY => ''} 2023-02-12 06:03:26,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks cb73533ba88ac459df56f2094bceddde 2023-02-12 06:03:26,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:26,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for cb73533ba88ac459df56f2094bceddde 2023-02-12 06:03:26,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for cb73533ba88ac459df56f2094bceddde 2023-02-12 06:03:26,079 INFO [StoreOpener-cb73533ba88ac459df56f2094bceddde-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cb73533ba88ac459df56f2094bceddde 2023-02-12 06:03:26,080 DEBUG [StoreOpener-cb73533ba88ac459df56f2094bceddde-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/f1 2023-02-12 06:03:26,080 DEBUG [StoreOpener-cb73533ba88ac459df56f2094bceddde-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/f1 2023-02-12 06:03:26,081 INFO [StoreOpener-cb73533ba88ac459df56f2094bceddde-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb73533ba88ac459df56f2094bceddde columnFamilyName f1 2023-02-12 06:03:26,081 INFO [StoreOpener-cb73533ba88ac459df56f2094bceddde-1] regionserver.HStore(310): Store=cb73533ba88ac459df56f2094bceddde/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:26,081 INFO [StoreOpener-cb73533ba88ac459df56f2094bceddde-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cb73533ba88ac459df56f2094bceddde 2023-02-12 06:03:26,082 DEBUG [StoreOpener-cb73533ba88ac459df56f2094bceddde-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/f2 2023-02-12 06:03:26,082 DEBUG [StoreOpener-cb73533ba88ac459df56f2094bceddde-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/f2 2023-02-12 06:03:26,082 INFO [StoreOpener-cb73533ba88ac459df56f2094bceddde-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb73533ba88ac459df56f2094bceddde columnFamilyName f2 2023-02-12 06:03:26,083 INFO [StoreOpener-cb73533ba88ac459df56f2094bceddde-1] regionserver.HStore(310): Store=cb73533ba88ac459df56f2094bceddde/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:26,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde 2023-02-12 06:03:26,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde 2023-02-12 06:03:26,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:03:26,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for cb73533ba88ac459df56f2094bceddde 2023-02-12 06:03:26,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:03:26,087 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened cb73533ba88ac459df56f2094bceddde; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74796740, jitterRate=0.11455827951431274}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:03:26,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for cb73533ba88ac459df56f2094bceddde: Running coprocessor pre-open hook at 1676181806078Writing region info on filesystem at 1676181806078Initializing all the Stores at 1676181806079 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181806079Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181806079Cleaning up temporary data from old regions at 1676181806084 (+5 ms)Cleaning up detritus from prior splits at 1676181806084Running coprocessor post-open hooks at 1676181806087 (+3 ms)Region opened successfully at 1676181806087 2023-02-12 06:03:26,088 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde., pid=12, masterSystemTime=1676181806073 2023-02-12 06:03:26,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde. 2023-02-12 06:03:26,091 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde. 2023-02-12 06:03:26,091 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=cb73533ba88ac459df56f2094bceddde, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:26,092 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676181806091"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676181806091"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676181806091"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676181806091"}]},"ts":"1676181806091"} 2023-02-12 06:03:26,095 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-12 06:03:26,095 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure cb73533ba88ac459df56f2094bceddde, server=jenkins-hbase4.apache.org,35839,1676181804588 in 172 msec 2023-02-12 06:03:26,097 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-12 06:03:26,097 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=cb73533ba88ac459df56f2094bceddde, ASSIGN in 330 msec 2023-02-12 06:03:26,097 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 06:03:26,097 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676181806097"}]},"ts":"1676181806097"} 2023-02-12 06:03:26,099 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-12 06:03:26,104 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 06:03:26,105 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 387 msec 2023-02-12 06:03:26,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 06:03:26,325 INFO [Listener at localhost/44093] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-12 06:03:26,325 DEBUG [Listener at localhost/44093] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-12 06:03:26,325 INFO [Listener at localhost/44093] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 06:03:26,327 INFO [Listener at localhost/44093] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-12 06:03:26,327 INFO [Listener at localhost/44093] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 06:03:26,327 INFO [Listener at localhost/44093] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-12 06:03:26,327 INFO [Listener at localhost/44093] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-12 06:03:26,339 DEBUG [hconnection-0x4a0760be-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 06:03:26,350 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38900, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 06:03:26,358 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35839] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde. 2023-02-12 06:03:26,451 INFO [Listener at localhost/44093] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-12 06:03:26,451 INFO [Listener at localhost/44093] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-12 06:03:26,452 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-12 06:03:26,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676181806452 (current time:1676181806452). 2023-02-12 06:03:26,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-12 06:03:26,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] zookeeper.ReadOnlyZKClient(139): Connect 0x6802f746 to 127.0.0.1:64834 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 06:03:26,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ebc8f78, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 06:03:26,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 06:03:26,458 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48004, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 06:03:26,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6802f746 to 127.0.0.1:64834 2023-02-12 06:03:26,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:26,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-12 06:03:26,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-12 06:03:26,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-12 06:03:26,463 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-12 06:03:26,463 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1676182406463 2023-02-12 06:03:26,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-12 06:03:26,464 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:26,465 DEBUG [Listener at localhost/44093] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-12 06:03:26,465 DEBUG [Listener at localhost/44093] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-12 06:03:26,466 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-12 06:03:26,466 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-12 06:03:26,467 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 5 msec 2023-02-12 06:03:26,467 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-12 06:03:26,468 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1676182406468 2023-02-12 06:03:26,481 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-12 06:03:26,481 INFO [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-12 06:03:26,481 DEBUG [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 06:03:26,483 DEBUG [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-12 06:03:26,483 DEBUG [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-12 06:03:26,483 DEBUG [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-12 06:03:26,483 DEBUG [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-12 06:03:26,484 DEBUG [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:26,484 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): regionserver:35839-0x10047207f8b0002, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 06:03:26,484 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): regionserver:41805-0x10047207f8b0001, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 06:03:26,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 06:03:26,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 06:03:26,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:03:26,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:03:26,488 DEBUG [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:26,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-12 06:03:26,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-12 06:03:26,488 DEBUG [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 06:03:26,488 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41805-0x10047207f8b0001, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-12 06:03:26,488 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35839-0x10047207f8b0002, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-12 06:03:26,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-12 06:03:26,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-12 06:03:26,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-12 06:03:26,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-12 06:03:26,489 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-12 06:03:26,489 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-12 06:03:26,492 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-12 06:03:26,492 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-12 06:03:26,492 DEBUG [member: 'jenkins-hbase4.apache.org,41805,1676181804566' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-12 06:03:26,492 DEBUG [member: 'jenkins-hbase4.apache.org,41805,1676181804566' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 06:03:26,494 DEBUG [member: 'jenkins-hbase4.apache.org,41805,1676181804566' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-12 06:03:26,494 DEBUG [member: 'jenkins-hbase4.apache.org,41805,1676181804566' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-12 06:03:26,494 DEBUG [member: 'jenkins-hbase4.apache.org,35839,1676181804588' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-12 06:03:26,494 DEBUG [member: 'jenkins-hbase4.apache.org,35839,1676181804588' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 06:03:26,494 DEBUG [member: 'jenkins-hbase4.apache.org,41805,1676181804566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41805,1676181804566' joining acquired barrier for procedure (foo) in zk 2023-02-12 06:03:26,495 DEBUG [member: 'jenkins-hbase4.apache.org,35839,1676181804588' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-12 06:03:26,495 DEBUG [member: 'jenkins-hbase4.apache.org,35839,1676181804588' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-12 06:03:26,495 DEBUG [member: 'jenkins-hbase4.apache.org,35839,1676181804588' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35839,1676181804588' joining acquired barrier for procedure (foo) in zk 2023-02-12 06:03:26,497 DEBUG [member: 'jenkins-hbase4.apache.org,41805,1676181804566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-12 06:03:26,497 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:26,497 DEBUG [member: 'jenkins-hbase4.apache.org,35839,1676181804588' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-12 06:03:26,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:26,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:26,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 06:03:26,497 DEBUG [member: 'jenkins-hbase4.apache.org,41805,1676181804566' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41805-0x10047207f8b0001, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-12 06:03:26,497 DEBUG [member: 'jenkins-hbase4.apache.org,41805,1676181804566' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 06:03:26,498 DEBUG [member: 'jenkins-hbase4.apache.org,35839,1676181804588' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35839-0x10047207f8b0002, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-12 06:03:26,498 DEBUG [member: 'jenkins-hbase4.apache.org,35839,1676181804588' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 06:03:26,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:26,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:26,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 06:03:26,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41805,1676181804566 2023-02-12 06:03:26,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:26,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:26,499 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35839,1676181804588' joining acquired barrier for procedure 'foo' on coordinator 2023-02-12 06:03:26,499 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@235334f[Count = 0] remaining members to acquire global barrier 2023-02-12 06:03:26,499 DEBUG [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-12 06:03:26,499 DEBUG [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-12 06:03:26,500 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): regionserver:35839-0x10047207f8b0002, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-12 06:03:26,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-12 06:03:26,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-12 06:03:26,501 DEBUG [member: 'jenkins-hbase4.apache.org,35839,1676181804588' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-12 06:03:26,501 DEBUG [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:26,501 DEBUG [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 06:03:26,501 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): regionserver:41805-0x10047207f8b0001, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-12 06:03:26,501 DEBUG [member: 'jenkins-hbase4.apache.org,35839,1676181804588' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-12 06:03:26,501 DEBUG [member: 'jenkins-hbase4.apache.org,35839,1676181804588' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 06:03:26,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-12 06:03:26,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-12 06:03:26,501 DEBUG [rs(jenkins-hbase4.apache.org,35839,1676181804588)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde. 2023-02-12 06:03:26,501 DEBUG [member: 'jenkins-hbase4.apache.org,41805,1676181804566' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-12 06:03:26,501 DEBUG [rs(jenkins-hbase4.apache.org,35839,1676181804588)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde. started... 2023-02-12 06:03:26,501 DEBUG [member: 'jenkins-hbase4.apache.org,41805,1676181804566' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-12 06:03:26,501 DEBUG [member: 'jenkins-hbase4.apache.org,41805,1676181804566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,41805,1676181804566' in zk 2023-02-12 06:03:26,501 INFO [rs(jenkins-hbase4.apache.org,35839,1676181804588)-snapshot-pool-0] regionserver.HRegion(2744): Flushing cb73533ba88ac459df56f2094bceddde 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-12 06:03:26,502 DEBUG [member: 'jenkins-hbase4.apache.org,41805,1676181804566' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-12 06:03:26,502 DEBUG [member: 'jenkins-hbase4.apache.org,41805,1676181804566' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:03:26,503 DEBUG [member: 'jenkins-hbase4.apache.org,41805,1676181804566' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-12 06:03:26,515 INFO [rs(jenkins-hbase4.apache.org,35839,1676181804588)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/.tmp/f1/7a4670ff9b2243858b8300e94c60b0f8 2023-02-12 06:03:26,534 INFO [rs(jenkins-hbase4.apache.org,35839,1676181804588)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/.tmp/f2/d0d5e5c40cc943fda9dd22fc49adb222 2023-02-12 06:03:26,538 DEBUG [rs(jenkins-hbase4.apache.org,35839,1676181804588)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/.tmp/f1/7a4670ff9b2243858b8300e94c60b0f8 as hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/f1/7a4670ff9b2243858b8300e94c60b0f8 2023-02-12 06:03:26,541 INFO [rs(jenkins-hbase4.apache.org,35839,1676181804588)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/f1/7a4670ff9b2243858b8300e94c60b0f8, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-12 06:03:26,542 DEBUG [rs(jenkins-hbase4.apache.org,35839,1676181804588)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/.tmp/f2/d0d5e5c40cc943fda9dd22fc49adb222 as hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/f2/d0d5e5c40cc943fda9dd22fc49adb222 2023-02-12 06:03:26,545 INFO [rs(jenkins-hbase4.apache.org,35839,1676181804588)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/f2/d0d5e5c40cc943fda9dd22fc49adb222, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-12 06:03:26,546 INFO [rs(jenkins-hbase4.apache.org,35839,1676181804588)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for cb73533ba88ac459df56f2094bceddde in 45ms, sequenceid=5, compaction requested=false 2023-02-12 06:03:26,546 DEBUG [rs(jenkins-hbase4.apache.org,35839,1676181804588)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-12 06:03:26,546 DEBUG [rs(jenkins-hbase4.apache.org,35839,1676181804588)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for cb73533ba88ac459df56f2094bceddde: 2023-02-12 06:03:26,546 DEBUG [rs(jenkins-hbase4.apache.org,35839,1676181804588)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde.' region-info for snapshot=foo 2023-02-12 06:03:26,546 DEBUG [rs(jenkins-hbase4.apache.org,35839,1676181804588)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 06:03:26,546 DEBUG [rs(jenkins-hbase4.apache.org,35839,1676181804588)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/f1/7a4670ff9b2243858b8300e94c60b0f8] hfiles 2023-02-12 06:03:26,546 DEBUG [rs(jenkins-hbase4.apache.org,35839,1676181804588)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/f1/7a4670ff9b2243858b8300e94c60b0f8 for snapshot=foo 2023-02-12 06:03:26,547 DEBUG [rs(jenkins-hbase4.apache.org,35839,1676181804588)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/f2/d0d5e5c40cc943fda9dd22fc49adb222] hfiles 2023-02-12 06:03:26,547 DEBUG [rs(jenkins-hbase4.apache.org,35839,1676181804588)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/f2/d0d5e5c40cc943fda9dd22fc49adb222 for snapshot=foo 2023-02-12 06:03:26,552 DEBUG [rs(jenkins-hbase4.apache.org,35839,1676181804588)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde. completed. 2023-02-12 06:03:26,552 DEBUG [rs(jenkins-hbase4.apache.org,35839,1676181804588)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde. 2023-02-12 06:03:26,552 DEBUG [member: 'jenkins-hbase4.apache.org,35839,1676181804588' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-12 06:03:26,552 DEBUG [member: 'jenkins-hbase4.apache.org,35839,1676181804588' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-12 06:03:26,552 DEBUG [member: 'jenkins-hbase4.apache.org,35839,1676181804588' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:26,552 DEBUG [member: 'jenkins-hbase4.apache.org,35839,1676181804588' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-12 06:03:26,552 DEBUG [member: 'jenkins-hbase4.apache.org,35839,1676181804588' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,35839,1676181804588' in zk 2023-02-12 06:03:26,554 DEBUG [member: 'jenkins-hbase4.apache.org,35839,1676181804588' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-12 06:03:26,554 DEBUG [member: 'jenkins-hbase4.apache.org,35839,1676181804588' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:03:26,554 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:26,554 DEBUG [member: 'jenkins-hbase4.apache.org,35839,1676181804588' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-12 06:03:26,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:26,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:26,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 06:03:26,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:26,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:26,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 06:03:26,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41805,1676181804566 2023-02-12 06:03:26,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:26,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:26,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 06:03:26,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41805,1676181804566 2023-02-12 06:03:26,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:26,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,35839,1676181804588': 2023-02-12 06:03:26,557 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35839,1676181804588' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-12 06:03:26,557 INFO [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-12 06:03:26,557 DEBUG [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 06:03:26,557 DEBUG [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 06:03:26,557 DEBUG [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-12 06:03:26,557 INFO [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-12 06:03:26,559 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-12 06:03:26,560 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): regionserver:35839-0x10047207f8b0002, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-12 06:03:26,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-12 06:03:26,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:26,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 06:03:26,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-12 06:03:26,560 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): regionserver:35839-0x10047207f8b0002, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 06:03:26,559 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): regionserver:41805-0x10047207f8b0001, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-12 06:03:26,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-12 06:03:26,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-12 06:03:26,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:26,560 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): regionserver:41805-0x10047207f8b0001, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 06:03:26,560 DEBUG [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41805,1676181804566 2023-02-12 06:03:26,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-12 06:03:26,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 06:03:26,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:03:26,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-12 06:03:26,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 06:03:26,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 06:03:26,561 DEBUG [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:26,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:03:26,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:26,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-12 06:03:26,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 06:03:26,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41805,1676181804566 2023-02-12 06:03:26,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:26,563 DEBUG [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41805,1676181804566 2023-02-12 06:03:26,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:26,563 DEBUG [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:26,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-12 06:03:26,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41805,1676181804566 2023-02-12 06:03:26,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:26,566 DEBUG [Listener at localhost/44093] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 06:03:26,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-12 06:03:26,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-12 06:03:26,567 DEBUG [Listener at localhost/44093] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-12 06:03:26,572 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): regionserver:41805-0x10047207f8b0001, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 06:03:26,572 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): regionserver:35839-0x10047207f8b0002, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 06:03:26,572 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:26,572 DEBUG [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:03:26,572 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): regionserver:35839-0x10047207f8b0002, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 06:03:26,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 06:03:26,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:03:26,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 06:03:26,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:03:26,572 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): regionserver:41805-0x10047207f8b0001, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 06:03:26,572 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-12 06:03:26,572 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-12 06:03:26,572 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-12 06:03:26,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 06:03:26,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:03:26,572 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,41805,1676181804566 2023-02-12 06:03:26,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 06:03:26,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:03:26,572 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-12 06:03:26,572 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:26,573 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-12 06:03:26,573 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,41805,1676181804566 2023-02-12 06:03:26,573 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-12 06:03:26,573 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-12 06:03:26,573 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/.hbase-snapshot/.tmp/foo 2023-02-12 06:03:26,597 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/.hbase-snapshot/.tmp/foo to hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/.hbase-snapshot/foo 2023-02-12 06:03:26,620 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-12 06:03:26,620 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/.hbase-snapshot/.tmp/foo 2023-02-12 06:03:26,620 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/.hbase-snapshot/.tmp/foo 2023-02-12 06:03:26,620 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1676181806464Consolidate snapshot: foo at 1676181806572 (+108 ms)Loading Region manifests for foo at 1676181806572Writing data manifest for foo at 1676181806575 (+3 ms)Verifying snapshot: foo at 1676181806589 (+14 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1676181806620 (+31 ms) 2023-02-12 06:03:26,623 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-12 06:03:26,624 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 158 msec 2023-02-12 06:03:26,767 DEBUG [Listener at localhost/44093] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 06:03:26,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-12 06:03:26,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-12 06:03:26,769 INFO [Listener at localhost/44093] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-12 06:03:26,772 INFO [Listener at localhost/44093] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-12 06:03:26,825 INFO [Listener at localhost/44093] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-12 06:03:26,852 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35839] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde. 2023-02-12 06:03:26,951 INFO [Listener at localhost/44093] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-12 06:03:26,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-12 06:03:26,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:26,958 INFO [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-12 06:03:26,958 DEBUG [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 06:03:26,959 DEBUG [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-12 06:03:26,959 DEBUG [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-12 06:03:26,960 DEBUG [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:26,960 DEBUG [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:26,961 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): regionserver:35839-0x10047207f8b0002, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 06:03:26,961 DEBUG [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:26,961 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): regionserver:41805-0x10047207f8b0001, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 06:03:26,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 06:03:26,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 06:03:26,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:03:26,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:03:26,961 DEBUG [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:26,961 DEBUG [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 06:03:26,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:26,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:26,962 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41805-0x10047207f8b0001, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:26,962 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35839-0x10047207f8b0002, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:26,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 06:03:26,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 06:03:26,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:26,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:26,962 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:26,962 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:26,962 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:26,962 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:26,962 DEBUG [member: 'jenkins-hbase4.apache.org,35839,1676181804588' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-12 06:03:26,963 DEBUG [member: 'jenkins-hbase4.apache.org,41805,1676181804566' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-12 06:03:26,963 DEBUG [member: 'jenkins-hbase4.apache.org,41805,1676181804566' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 06:03:26,963 DEBUG [member: 'jenkins-hbase4.apache.org,35839,1676181804588' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 06:03:26,963 DEBUG [member: 'jenkins-hbase4.apache.org,41805,1676181804566' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-12 06:03:26,963 DEBUG [member: 'jenkins-hbase4.apache.org,41805,1676181804566' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-12 06:03:26,964 DEBUG [member: 'jenkins-hbase4.apache.org,35839,1676181804588' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-12 06:03:26,964 DEBUG [member: 'jenkins-hbase4.apache.org,41805,1676181804566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41805,1676181804566' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-12 06:03:26,964 DEBUG [member: 'jenkins-hbase4.apache.org,35839,1676181804588' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 06:03:26,964 DEBUG [member: 'jenkins-hbase4.apache.org,35839,1676181804588' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 06:03:26,964 DEBUG [rs(jenkins-hbase4.apache.org,35839,1676181804588)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde. 2023-02-12 06:03:26,964 DEBUG [rs(jenkins-hbase4.apache.org,35839,1676181804588)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde. started... 2023-02-12 06:03:26,964 INFO [rs(jenkins-hbase4.apache.org,35839,1676181804588)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing cb73533ba88ac459df56f2094bceddde 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-12 06:03:26,965 DEBUG [member: 'jenkins-hbase4.apache.org,41805,1676181804566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:26,966 DEBUG [member: 'jenkins-hbase4.apache.org,41805,1676181804566' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41805-0x10047207f8b0001, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:26,966 DEBUG [member: 'jenkins-hbase4.apache.org,41805,1676181804566' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 06:03:26,978 INFO [rs(jenkins-hbase4.apache.org,35839,1676181804588)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/.tmp/f1/bab9251d88f44f5aafcc9e7a74ce2e69 2023-02-12 06:03:26,995 INFO [rs(jenkins-hbase4.apache.org,35839,1676181804588)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/.tmp/f2/0ef2d86c96fa4eb883fa7e29d7b8bc46 2023-02-12 06:03:26,999 DEBUG [rs(jenkins-hbase4.apache.org,35839,1676181804588)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/.tmp/f1/bab9251d88f44f5aafcc9e7a74ce2e69 as hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/f1/bab9251d88f44f5aafcc9e7a74ce2e69 2023-02-12 06:03:27,002 INFO [rs(jenkins-hbase4.apache.org,35839,1676181804588)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/f1/bab9251d88f44f5aafcc9e7a74ce2e69, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-12 06:03:27,002 DEBUG [rs(jenkins-hbase4.apache.org,35839,1676181804588)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/.tmp/f2/0ef2d86c96fa4eb883fa7e29d7b8bc46 as hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/f2/0ef2d86c96fa4eb883fa7e29d7b8bc46 2023-02-12 06:03:27,006 INFO [rs(jenkins-hbase4.apache.org,35839,1676181804588)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/f2/0ef2d86c96fa4eb883fa7e29d7b8bc46, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-12 06:03:27,006 INFO [rs(jenkins-hbase4.apache.org,35839,1676181804588)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for cb73533ba88ac459df56f2094bceddde in 42ms, sequenceid=9, compaction requested=false 2023-02-12 06:03:27,007 DEBUG [rs(jenkins-hbase4.apache.org,35839,1676181804588)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for cb73533ba88ac459df56f2094bceddde: 2023-02-12 06:03:27,007 DEBUG [rs(jenkins-hbase4.apache.org,35839,1676181804588)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde. 2023-02-12 06:03:27,007 DEBUG [member: 'jenkins-hbase4.apache.org,35839,1676181804588' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 06:03:27,008 DEBUG [member: 'jenkins-hbase4.apache.org,35839,1676181804588' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 06:03:27,008 DEBUG [member: 'jenkins-hbase4.apache.org,35839,1676181804588' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:27,008 DEBUG [member: 'jenkins-hbase4.apache.org,35839,1676181804588' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-12 06:03:27,008 DEBUG [member: 'jenkins-hbase4.apache.org,35839,1676181804588' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35839,1676181804588' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-12 06:03:27,009 DEBUG [member: 'jenkins-hbase4.apache.org,35839,1676181804588' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,009 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:27,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:27,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:27,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 06:03:27,009 DEBUG [member: 'jenkins-hbase4.apache.org,35839,1676181804588' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35839-0x10047207f8b0002, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,009 DEBUG [member: 'jenkins-hbase4.apache.org,35839,1676181804588' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 06:03:27,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:27,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:27,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41805,1676181804566 2023-02-12 06:03:27,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:27,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:27,011 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35839,1676181804588' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-12 06:03:27,011 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@60ab7d1[Count = 0] remaining members to acquire global barrier 2023-02-12 06:03:27,011 DEBUG [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-12 06:03:27,011 DEBUG [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,013 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): regionserver:35839-0x10047207f8b0002, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,013 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): regionserver:41805-0x10047207f8b0001, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,013 DEBUG [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:27,014 DEBUG [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 06:03:27,014 DEBUG [member: 'jenkins-hbase4.apache.org,35839,1676181804588' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-12 06:03:27,014 DEBUG [member: 'jenkins-hbase4.apache.org,35839,1676181804588' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-12 06:03:27,013 DEBUG [member: 'jenkins-hbase4.apache.org,41805,1676181804566' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-12 06:03:27,014 DEBUG [member: 'jenkins-hbase4.apache.org,41805,1676181804566' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-12 06:03:27,014 DEBUG [member: 'jenkins-hbase4.apache.org,35839,1676181804588' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,35839,1676181804588' in zk 2023-02-12 06:03:27,014 DEBUG [member: 'jenkins-hbase4.apache.org,41805,1676181804566' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,41805,1676181804566' in zk 2023-02-12 06:03:27,015 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:27,015 DEBUG [member: 'jenkins-hbase4.apache.org,41805,1676181804566' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-12 06:03:27,015 DEBUG [member: 'jenkins-hbase4.apache.org,35839,1676181804588' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-12 06:03:27,015 DEBUG [member: 'jenkins-hbase4.apache.org,41805,1676181804566' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:03:27,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:27,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:27,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 06:03:27,015 DEBUG [member: 'jenkins-hbase4.apache.org,41805,1676181804566' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-12 06:03:27,015 DEBUG [member: 'jenkins-hbase4.apache.org,35839,1676181804588' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:03:27,015 DEBUG [member: 'jenkins-hbase4.apache.org,35839,1676181804588' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-12 06:03:27,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:27,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:27,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41805,1676181804566 2023-02-12 06:03:27,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:27,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:27,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41805,1676181804566 2023-02-12 06:03:27,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:27,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' member 'jenkins-hbase4.apache.org,35839,1676181804588': 2023-02-12 06:03:27,018 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35839,1676181804588' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-12 06:03:27,018 INFO [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-12 06:03:27,018 DEBUG [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 06:03:27,018 DEBUG [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 06:03:27,018 DEBUG [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,018 INFO [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 06:03:27,019 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): regionserver:41805-0x10047207f8b0001, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,019 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): regionserver:35839-0x10047207f8b0002, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,020 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): regionserver:35839-0x10047207f8b0002, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 06:03:27,020 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): regionserver:41805-0x10047207f8b0001, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 06:03:27,019 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:27,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 06:03:27,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,020 DEBUG [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41805,1676181804566 2023-02-12 06:03:27,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 06:03:27,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:03:27,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:27,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 06:03:27,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:03:27,020 DEBUG [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:27,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:27,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41805,1676181804566 2023-02-12 06:03:27,022 DEBUG [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41805,1676181804566 2023-02-12 06:03:27,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:27,022 DEBUG [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:27,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:27,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41805,1676181804566 2023-02-12 06:03:27,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:27,024 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): regionserver:41805-0x10047207f8b0001, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 06:03:27,024 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): regionserver:35839-0x10047207f8b0002, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 06:03:27,024 DEBUG [(jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:03:27,024 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): regionserver:35839-0x10047207f8b0002, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 06:03:27,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 06:03:27,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:03:27,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-12 06:03:27,025 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 06:03:27,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 06:03:27,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:03:27,024 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): regionserver:41805-0x10047207f8b0001, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 06:03:27,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 06:03:27,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:03:27,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 06:03:27,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:03:27,025 DEBUG [Listener at localhost/44093] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-12 06:03:27,025 DEBUG [Listener at localhost/44093] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 06:03:27,028 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:27,028 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,028 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41805,1676181804566 2023-02-12 06:03:27,028 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,028 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:27,028 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,028 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,41805,1676181804566 2023-02-12 06:03:27,028 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,028 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,125 DEBUG [Listener at localhost/44093] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 06:03:27,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 06:03:27,131 INFO [Listener at localhost/44093] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676181806452 type: FLUSH version: 2 ttl: 0 2023-02-12 06:03:27,131 DEBUG [Listener at localhost/44093] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:35831/user/jenkins/test-data/3e31b4e3-6a8e-718d-3e31-85ab63258e32/foo/49091835-9285-42e9-8b8a-fb314b195ec0/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,131 INFO [Listener at localhost/44093] snapshot.RestoreSnapshotHelper(239): region to add: cb73533ba88ac459df56f2094bceddde 2023-02-12 06:03:27,131 INFO [Listener at localhost/44093] snapshot.RestoreSnapshotHelper(585): clone region=cb73533ba88ac459df56f2094bceddde as cb73533ba88ac459df56f2094bceddde in snapshot foo 2023-02-12 06:03:27,132 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => cb73533ba88ac459df56f2094bceddde, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35831/user/jenkins/test-data/3e31b4e3-6a8e-718d-3e31-85ab63258e32/foo/49091835-9285-42e9-8b8a-fb314b195ec0 2023-02-12 06:03:27,137 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:27,138 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 7a4670ff9b2243858b8300e94c60b0f8 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,140 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d0d5e5c40cc943fda9dd22fc49adb222 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,141 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing cb73533ba88ac459df56f2094bceddde, disabling compactions & flushes 2023-02-12 06:03:27,142 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde. 2023-02-12 06:03:27,142 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde. 2023-02-12 06:03:27,142 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde. after waiting 0 ms 2023-02-12 06:03:27,142 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde. 2023-02-12 06:03:27,142 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde. 2023-02-12 06:03:27,142 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for cb73533ba88ac459df56f2094bceddde: Waiting for close lock at 1676181807141Disabling compacts and flushes for region at 1676181807141Disabling writes for close at 1676181807142 (+1 ms)Writing region close event to WAL at 1676181807142Closed at 1676181807142 2023-02-12 06:03:27,143 INFO [Listener at localhost/44093] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676181806452 type: FLUSH version: 2 ttl: 0 2023-02-12 06:03:27,143 DEBUG [Listener at localhost/44093] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:35831/user/jenkins/test-data/3e31b4e3-6a8e-718d-3e31-85ab63258e32/foo/49091835-9285-42e9-8b8a-fb314b195ec0 2023-02-12 06:03:27,143 DEBUG [Listener at localhost/44093] util.CommonFSUtils(682): File system contents for path hdfs://localhost:35831/user/jenkins/test-data/3e31b4e3-6a8e-718d-3e31-85ab63258e32/foo/49091835-9285-42e9-8b8a-fb314b195ec0 2023-02-12 06:03:27,144 DEBUG [Listener at localhost/44093] util.CommonFSUtils(699): |-data/ 2023-02-12 06:03:27,144 DEBUG [Listener at localhost/44093] util.CommonFSUtils(699): |----default/ 2023-02-12 06:03:27,145 DEBUG [Listener at localhost/44093] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-12 06:03:27,145 DEBUG [Listener at localhost/44093] util.CommonFSUtils(699): |----------cb73533ba88ac459df56f2094bceddde/ 2023-02-12 06:03:27,145 DEBUG [Listener at localhost/44093] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 06:03:27,145 DEBUG [Listener at localhost/44093] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 06:03:27,146 DEBUG [Listener at localhost/44093] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=cb73533ba88ac459df56f2094bceddde-7a4670ff9b2243858b8300e94c60b0f8 2023-02-12 06:03:27,146 DEBUG [Listener at localhost/44093] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 06:03:27,146 DEBUG [Listener at localhost/44093] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=cb73533ba88ac459df56f2094bceddde-d0d5e5c40cc943fda9dd22fc49adb222 hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/f1/7a4670ff9b2243858b8300e94c60b0f8 hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/f1/bab9251d88f44f5aafcc9e7a74ce2e69 hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/f2/0ef2d86c96fa4eb883fa7e29d7b8bc46 hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/f2/d0d5e5c40cc943fda9dd22fc49adb222 2023-02-12 06:03:27,152 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-12 06:03:27,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-12 06:03:27,155 INFO [Listener at localhost/44093] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,155 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 06:03:27,158 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676181807158"}]},"ts":"1676181807158"} 2023-02-12 06:03:27,159 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-12 06:03:27,162 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-12 06:03:27,162 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=cb73533ba88ac459df56f2094bceddde, UNASSIGN}] 2023-02-12 06:03:27,164 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=cb73533ba88ac459df56f2094bceddde, UNASSIGN 2023-02-12 06:03:27,164 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=cb73533ba88ac459df56f2094bceddde, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:27,164 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676181807164"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181807164"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181807164"}]},"ts":"1676181807164"} 2023-02-12 06:03:27,165 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure cb73533ba88ac459df56f2094bceddde, server=jenkins-hbase4.apache.org,35839,1676181804588}] 2023-02-12 06:03:27,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 06:03:27,317 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close cb73533ba88ac459df56f2094bceddde 2023-02-12 06:03:27,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing cb73533ba88ac459df56f2094bceddde, disabling compactions & flushes 2023-02-12 06:03:27,317 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde. 2023-02-12 06:03:27,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde. 2023-02-12 06:03:27,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde. after waiting 1 ms 2023-02-12 06:03:27,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde. 2023-02-12 06:03:27,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 06:03:27,322 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde. 2023-02-12 06:03:27,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for cb73533ba88ac459df56f2094bceddde: Waiting for close lock at 1676181807317Running coprocessor pre-close hooks at 1676181807317Disabling compacts and flushes for region at 1676181807317Disabling writes for close at 1676181807318 (+1 ms)Writing region close event to WAL at 1676181807318Running coprocessor post-close hooks at 1676181807322 (+4 ms)Closed at 1676181807322 2023-02-12 06:03:27,323 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed cb73533ba88ac459df56f2094bceddde 2023-02-12 06:03:27,323 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=cb73533ba88ac459df56f2094bceddde, regionState=CLOSED 2023-02-12 06:03:27,324 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676181807323"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181807323"}]},"ts":"1676181807323"} 2023-02-12 06:03:27,326 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-12 06:03:27,326 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure cb73533ba88ac459df56f2094bceddde, server=jenkins-hbase4.apache.org,35839,1676181804588 in 160 msec 2023-02-12 06:03:27,327 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-12 06:03:27,327 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=cb73533ba88ac459df56f2094bceddde, UNASSIGN in 164 msec 2023-02-12 06:03:27,328 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676181807328"}]},"ts":"1676181807328"} 2023-02-12 06:03:27,329 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-12 06:03:27,330 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-12 06:03:27,332 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 176 msec 2023-02-12 06:03:27,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 06:03:27,461 INFO [Listener at localhost/44093] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-12 06:03:27,462 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,464 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,465 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-12 06:03:27,468 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde 2023-02-12 06:03:27,469 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/f1, FileablePath, hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/f2, FileablePath, hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/recovered.edits] 2023-02-12 06:03:27,472 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/f1/7a4670ff9b2243858b8300e94c60b0f8 to hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/f1/7a4670ff9b2243858b8300e94c60b0f8 2023-02-12 06:03:27,473 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/f1/bab9251d88f44f5aafcc9e7a74ce2e69 to hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/f1/bab9251d88f44f5aafcc9e7a74ce2e69 2023-02-12 06:03:27,478 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/f2/0ef2d86c96fa4eb883fa7e29d7b8bc46 to hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/f2/0ef2d86c96fa4eb883fa7e29d7b8bc46 2023-02-12 06:03:27,479 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/f2/d0d5e5c40cc943fda9dd22fc49adb222 to hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/f2/d0d5e5c40cc943fda9dd22fc49adb222 2023-02-12 06:03:27,481 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/recovered.edits/12.seqid to hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde/recovered.edits/12.seqid 2023-02-12 06:03:27,482 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/cb73533ba88ac459df56f2094bceddde 2023-02-12 06:03:27,482 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-12 06:03:27,484 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,485 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-12 06:03:27,486 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-12 06:03:27,489 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,489 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-12 06:03:27,490 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676181807489"}]},"ts":"9223372036854775807"} 2023-02-12 06:03:27,491 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-12 06:03:27,491 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => cb73533ba88ac459df56f2094bceddde, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676181805717.cb73533ba88ac459df56f2094bceddde.', STARTKEY => '', ENDKEY => ''}] 2023-02-12 06:03:27,491 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-12 06:03:27,491 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676181807491"}]},"ts":"9223372036854775807"} 2023-02-12 06:03:27,492 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-12 06:03:27,494 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-12 06:03:27,495 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 32 msec 2023-02-12 06:03:27,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35999] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-12 06:03:27,567 INFO [Listener at localhost/44093] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-12 06:03:27,567 INFO [Listener at localhost/44093] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-12 06:03:27,567 INFO [Listener at localhost/44093] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 06:03:27,567 DEBUG [Listener at localhost/44093] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x52b2ce3f to 127.0.0.1:64834 2023-02-12 06:03:27,567 DEBUG [Listener at localhost/44093] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:27,567 DEBUG [Listener at localhost/44093] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-12 06:03:27,568 DEBUG [Listener at localhost/44093] util.JVMClusterUtil(257): Found active master hash=316476642, stopped=false 2023-02-12 06:03:27,568 INFO [Listener at localhost/44093] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,35999,1676181804506 2023-02-12 06:03:27,570 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 06:03:27,570 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): regionserver:35839-0x10047207f8b0002, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 06:03:27,570 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:27,570 INFO [Listener at localhost/44093] procedure2.ProcedureExecutor(629): Stopping 2023-02-12 06:03:27,570 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): regionserver:41805-0x10047207f8b0001, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 06:03:27,570 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:03:27,570 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35839-0x10047207f8b0002, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:03:27,572 DEBUG [Listener at localhost/44093] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x35dc9f71 to 127.0.0.1:64834 2023-02-12 06:03:27,572 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41805-0x10047207f8b0001, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:03:27,572 DEBUG [Listener at localhost/44093] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:27,572 INFO [Listener at localhost/44093] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41805,1676181804566' ***** 2023-02-12 06:03:27,572 INFO [Listener at localhost/44093] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 06:03:27,572 INFO [Listener at localhost/44093] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35839,1676181804588' ***** 2023-02-12 06:03:27,572 INFO [Listener at localhost/44093] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 06:03:27,572 INFO [RS:0;jenkins-hbase4:41805] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 06:03:27,572 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 06:03:27,573 INFO [RS:1;jenkins-hbase4:35839] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 06:03:27,574 INFO [RS:0;jenkins-hbase4:41805] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 06:03:27,574 INFO [RS:1;jenkins-hbase4:35839] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 06:03:27,574 INFO [RS:0;jenkins-hbase4:41805] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 06:03:27,574 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 06:03:27,574 INFO [RS:0;jenkins-hbase4:41805] regionserver.HRegionServer(3304): Received CLOSE for 7feb1b58d0a981cd65359ae54665b538 2023-02-12 06:03:27,574 INFO [RS:1;jenkins-hbase4:35839] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 06:03:27,575 INFO [RS:0;jenkins-hbase4:41805] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41805,1676181804566 2023-02-12 06:03:27,575 INFO [RS:1;jenkins-hbase4:35839] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:27,575 DEBUG [RS:0;jenkins-hbase4:41805] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4bb73a2f to 127.0.0.1:64834 2023-02-12 06:03:27,575 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7feb1b58d0a981cd65359ae54665b538, disabling compactions & flushes 2023-02-12 06:03:27,575 DEBUG [RS:1;jenkins-hbase4:35839] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50f9e1c7 to 127.0.0.1:64834 2023-02-12 06:03:27,575 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676181805157.7feb1b58d0a981cd65359ae54665b538. 2023-02-12 06:03:27,575 DEBUG [RS:0;jenkins-hbase4:41805] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:27,575 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676181805157.7feb1b58d0a981cd65359ae54665b538. 2023-02-12 06:03:27,575 DEBUG [RS:1;jenkins-hbase4:35839] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:27,575 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676181805157.7feb1b58d0a981cd65359ae54665b538. after waiting 0 ms 2023-02-12 06:03:27,575 INFO [RS:1;jenkins-hbase4:35839] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35839,1676181804588; all regions closed. 2023-02-12 06:03:27,575 INFO [RS:0;jenkins-hbase4:41805] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 06:03:27,575 INFO [RS:0;jenkins-hbase4:41805] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 06:03:27,575 INFO [RS:0;jenkins-hbase4:41805] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 06:03:27,575 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676181805157.7feb1b58d0a981cd65359ae54665b538. 2023-02-12 06:03:27,575 INFO [RS:0;jenkins-hbase4:41805] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-12 06:03:27,576 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 7feb1b58d0a981cd65359ae54665b538 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-12 06:03:27,576 INFO [RS:0;jenkins-hbase4:41805] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-12 06:03:27,576 DEBUG [RS:0;jenkins-hbase4:41805] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 7feb1b58d0a981cd65359ae54665b538=hbase:namespace,,1676181805157.7feb1b58d0a981cd65359ae54665b538.} 2023-02-12 06:03:27,576 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 06:03:27,576 DEBUG [RS:0;jenkins-hbase4:41805] regionserver.HRegionServer(1505): Waiting on 1588230740, 7feb1b58d0a981cd65359ae54665b538 2023-02-12 06:03:27,576 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 06:03:27,576 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 06:03:27,576 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 06:03:27,576 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 06:03:27,576 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.46 KB heapSize=7.87 KB 2023-02-12 06:03:27,581 DEBUG [RS:1;jenkins-hbase4:35839] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/oldWALs 2023-02-12 06:03:27,581 INFO [RS:1;jenkins-hbase4:35839] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35839%2C1676181804588:(num 1676181805879) 2023-02-12 06:03:27,581 DEBUG [RS:1;jenkins-hbase4:35839] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:27,581 INFO [RS:1;jenkins-hbase4:35839] regionserver.LeaseManager(133): Closed leases 2023-02-12 06:03:27,581 INFO [RS:1;jenkins-hbase4:35839] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-12 06:03:27,582 INFO [RS:1;jenkins-hbase4:35839] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 06:03:27,582 INFO [RS:1;jenkins-hbase4:35839] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 06:03:27,582 INFO [RS:1;jenkins-hbase4:35839] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 06:03:27,582 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 06:03:27,583 INFO [RS:1;jenkins-hbase4:35839] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35839 2023-02-12 06:03:27,589 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): regionserver:41805-0x10047207f8b0001, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:27,589 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): regionserver:35839-0x10047207f8b0002, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35839,1676181804588 2023-02-12 06:03:27,589 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): regionserver:41805-0x10047207f8b0001, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 06:03:27,589 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 06:03:27,593 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/hbase/namespace/7feb1b58d0a981cd65359ae54665b538/.tmp/info/1c743d1f087d4012aa216dc78f8be06d 2023-02-12 06:03:27,593 ERROR [Listener at localhost/44093-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1180cf6d rejected from java.util.concurrent.ThreadPoolExecutor@15bf4985[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:27,593 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): regionserver:35839-0x10047207f8b0002, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 06:03:27,593 ERROR [Listener at localhost/44093-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@764b153e rejected from java.util.concurrent.ThreadPoolExecutor@15bf4985[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:27,593 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35839,1676181804588] 2023-02-12 06:03:27,593 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35839,1676181804588; numProcessing=1 2023-02-12 06:03:27,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/hbase/namespace/7feb1b58d0a981cd65359ae54665b538/.tmp/info/1c743d1f087d4012aa216dc78f8be06d as hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/hbase/namespace/7feb1b58d0a981cd65359ae54665b538/info/1c743d1f087d4012aa216dc78f8be06d 2023-02-12 06:03:27,599 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35839,1676181804588 already deleted, retry=false 2023-02-12 06:03:27,599 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35839,1676181804588 expired; onlineServers=1 2023-02-12 06:03:27,601 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/hbase/meta/1588230740/.tmp/info/e470ee89112a4d3da46cb2a8bf573382 2023-02-12 06:03:27,605 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/hbase/namespace/7feb1b58d0a981cd65359ae54665b538/info/1c743d1f087d4012aa216dc78f8be06d, entries=2, sequenceid=6, filesize=4.8 K 2023-02-12 06:03:27,606 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e470ee89112a4d3da46cb2a8bf573382 2023-02-12 06:03:27,606 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 7feb1b58d0a981cd65359ae54665b538 in 30ms, sequenceid=6, compaction requested=false 2023-02-12 06:03:27,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/hbase/namespace/7feb1b58d0a981cd65359ae54665b538/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-12 06:03:27,610 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676181805157.7feb1b58d0a981cd65359ae54665b538. 2023-02-12 06:03:27,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7feb1b58d0a981cd65359ae54665b538: Waiting for close lock at 1676181807575Running coprocessor pre-close hooks at 1676181807575Disabling compacts and flushes for region at 1676181807575Disabling writes for close at 1676181807575Obtaining lock to block concurrent updates at 1676181807576 (+1 ms)Preparing flush snapshotting stores in 7feb1b58d0a981cd65359ae54665b538 at 1676181807576Finished memstore snapshotting hbase:namespace,,1676181805157.7feb1b58d0a981cd65359ae54665b538., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676181807576Flushing stores of hbase:namespace,,1676181805157.7feb1b58d0a981cd65359ae54665b538. at 1676181807576Flushing 7feb1b58d0a981cd65359ae54665b538/info: creating writer at 1676181807577 (+1 ms)Flushing 7feb1b58d0a981cd65359ae54665b538/info: appending metadata at 1676181807581 (+4 ms)Flushing 7feb1b58d0a981cd65359ae54665b538/info: closing flushed file at 1676181807581Flushing 7feb1b58d0a981cd65359ae54665b538/info: reopening flushed file at 1676181807598 (+17 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 7feb1b58d0a981cd65359ae54665b538 in 30ms, sequenceid=6, compaction requested=false at 1676181807606 (+8 ms)Writing region close event to WAL at 1676181807607 (+1 ms)Running coprocessor post-close hooks at 1676181807610 (+3 ms)Closed at 1676181807610 2023-02-12 06:03:27,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676181805157.7feb1b58d0a981cd65359ae54665b538. 2023-02-12 06:03:27,618 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/hbase/meta/1588230740/.tmp/rep_barrier/cceff1a45b924176b806bc1b4f5da304 2023-02-12 06:03:27,621 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cceff1a45b924176b806bc1b4f5da304 2023-02-12 06:03:27,628 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/hbase/meta/1588230740/.tmp/table/69b330fc42c14c3e8ba7b5de9339fe0f 2023-02-12 06:03:27,631 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 69b330fc42c14c3e8ba7b5de9339fe0f 2023-02-12 06:03:27,632 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/hbase/meta/1588230740/.tmp/info/e470ee89112a4d3da46cb2a8bf573382 as hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/hbase/meta/1588230740/info/e470ee89112a4d3da46cb2a8bf573382 2023-02-12 06:03:27,635 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e470ee89112a4d3da46cb2a8bf573382 2023-02-12 06:03:27,635 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/hbase/meta/1588230740/info/e470ee89112a4d3da46cb2a8bf573382, entries=12, sequenceid=21, filesize=6.3 K 2023-02-12 06:03:27,636 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/hbase/meta/1588230740/.tmp/rep_barrier/cceff1a45b924176b806bc1b4f5da304 as hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/hbase/meta/1588230740/rep_barrier/cceff1a45b924176b806bc1b4f5da304 2023-02-12 06:03:27,639 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cceff1a45b924176b806bc1b4f5da304 2023-02-12 06:03:27,639 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/hbase/meta/1588230740/rep_barrier/cceff1a45b924176b806bc1b4f5da304, entries=1, sequenceid=21, filesize=5.1 K 2023-02-12 06:03:27,640 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/hbase/meta/1588230740/.tmp/table/69b330fc42c14c3e8ba7b5de9339fe0f as hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/hbase/meta/1588230740/table/69b330fc42c14c3e8ba7b5de9339fe0f 2023-02-12 06:03:27,643 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 69b330fc42c14c3e8ba7b5de9339fe0f 2023-02-12 06:03:27,643 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/hbase/meta/1588230740/table/69b330fc42c14c3e8ba7b5de9339fe0f, entries=4, sequenceid=21, filesize=5.1 K 2023-02-12 06:03:27,644 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 68ms, sequenceid=21, compaction requested=false 2023-02-12 06:03:27,644 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-12 06:03:27,650 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 06:03:27,654 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 06:03:27,655 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-12 06:03:27,656 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 06:03:27,656 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 06:03:27,656 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676181807576Running coprocessor pre-close hooks at 1676181807576Disabling compacts and flushes for region at 1676181807576Disabling writes for close at 1676181807576Obtaining lock to block concurrent updates at 1676181807576Preparing flush snapshotting stores in 1588230740 at 1676181807576Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4572, getHeapSize=8008, getOffHeapSize=0, getCellsCount=36 at 1676181807577 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1676181807578 (+1 ms)Flushing 1588230740/info: creating writer at 1676181807578Flushing 1588230740/info: appending metadata at 1676181807582 (+4 ms)Flushing 1588230740/info: closing flushed file at 1676181807582Flushing 1588230740/rep_barrier: creating writer at 1676181807606 (+24 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676181807609 (+3 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676181807609Flushing 1588230740/table: creating writer at 1676181807621 (+12 ms)Flushing 1588230740/table: appending metadata at 1676181807623 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676181807623Flushing 1588230740/info: reopening flushed file at 1676181807632 (+9 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676181807636 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1676181807640 (+4 ms)Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 68ms, sequenceid=21, compaction requested=false at 1676181807644 (+4 ms)Writing region close event to WAL at 1676181807652 (+8 ms)Running coprocessor post-close hooks at 1676181807656 (+4 ms)Closed at 1676181807656 2023-02-12 06:03:27,656 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-12 06:03:27,769 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): regionserver:35839-0x10047207f8b0002, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:03:27,769 INFO [RS:1;jenkins-hbase4:35839] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35839,1676181804588; zookeeper connection closed. 2023-02-12 06:03:27,769 ERROR [Listener at localhost/44093-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@ebbd9ed rejected from java.util.concurrent.ThreadPoolExecutor@15bf4985[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:27,769 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): regionserver:35839-0x10047207f8b0002, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:03:27,769 ERROR [Listener at localhost/44093-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1ede2bd0 rejected from java.util.concurrent.ThreadPoolExecutor@15bf4985[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:27,769 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5374ba0a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5374ba0a 2023-02-12 06:03:27,776 INFO [RS:0;jenkins-hbase4:41805] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41805,1676181804566; all regions closed. 2023-02-12 06:03:27,782 DEBUG [RS:0;jenkins-hbase4:41805] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/oldWALs 2023-02-12 06:03:27,782 INFO [RS:0;jenkins-hbase4:41805] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41805%2C1676181804566.meta:.meta(num 1676181805103) 2023-02-12 06:03:27,785 DEBUG [RS:0;jenkins-hbase4:41805] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/oldWALs 2023-02-12 06:03:27,785 INFO [RS:0;jenkins-hbase4:41805] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41805%2C1676181804566:(num 1676181805509) 2023-02-12 06:03:27,785 DEBUG [RS:0;jenkins-hbase4:41805] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:27,786 INFO [RS:0;jenkins-hbase4:41805] regionserver.LeaseManager(133): Closed leases 2023-02-12 06:03:27,786 INFO [RS:0;jenkins-hbase4:41805] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-12 06:03:27,786 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 06:03:27,787 INFO [RS:0;jenkins-hbase4:41805] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41805 2023-02-12 06:03:27,788 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): regionserver:41805-0x10047207f8b0001, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41805,1676181804566 2023-02-12 06:03:27,788 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 06:03:27,788 ERROR [Listener at localhost/44093-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@16c8d7aa rejected from java.util.concurrent.ThreadPoolExecutor@12f741ab[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:27,790 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41805,1676181804566] 2023-02-12 06:03:27,790 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41805,1676181804566; numProcessing=2 2023-02-12 06:03:27,791 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41805,1676181804566 already deleted, retry=false 2023-02-12 06:03:27,791 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41805,1676181804566 expired; onlineServers=0 2023-02-12 06:03:27,791 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35999,1676181804506' ***** 2023-02-12 06:03:27,791 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-12 06:03:27,792 DEBUG [M:0;jenkins-hbase4:35999] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@16e29a61, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 06:03:27,792 INFO [M:0;jenkins-hbase4:35999] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35999,1676181804506 2023-02-12 06:03:27,792 INFO [M:0;jenkins-hbase4:35999] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35999,1676181804506; all regions closed. 2023-02-12 06:03:27,792 DEBUG [M:0;jenkins-hbase4:35999] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:27,792 DEBUG [M:0;jenkins-hbase4:35999] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-12 06:03:27,792 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-12 06:03:27,792 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676181804739] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676181804739,5,FailOnTimeoutGroup] 2023-02-12 06:03:27,792 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676181804738] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676181804738,5,FailOnTimeoutGroup] 2023-02-12 06:03:27,792 DEBUG [M:0;jenkins-hbase4:35999] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-12 06:03:27,793 INFO [M:0;jenkins-hbase4:35999] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-12 06:03:27,793 INFO [M:0;jenkins-hbase4:35999] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-12 06:03:27,793 INFO [M:0;jenkins-hbase4:35999] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-12 06:03:27,793 DEBUG [M:0;jenkins-hbase4:35999] master.HMaster(1502): Stopping service threads 2023-02-12 06:03:27,793 INFO [M:0;jenkins-hbase4:35999] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-12 06:03:27,794 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-12 06:03:27,794 ERROR [M:0;jenkins-hbase4:35999] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-12 06:03:27,794 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:27,794 INFO [M:0;jenkins-hbase4:35999] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-12 06:03:27,794 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-12 06:03:27,794 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 06:03:27,795 DEBUG [M:0;jenkins-hbase4:35999] zookeeper.ZKUtil(398): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-12 06:03:27,795 WARN [M:0;jenkins-hbase4:35999] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-12 06:03:27,795 INFO [M:0;jenkins-hbase4:35999] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-12 06:03:27,795 INFO [M:0;jenkins-hbase4:35999] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-12 06:03:27,795 DEBUG [M:0;jenkins-hbase4:35999] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 06:03:27,795 INFO [M:0;jenkins-hbase4:35999] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:27,795 DEBUG [M:0;jenkins-hbase4:35999] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:27,795 DEBUG [M:0;jenkins-hbase4:35999] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 06:03:27,795 DEBUG [M:0;jenkins-hbase4:35999] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:27,796 INFO [M:0;jenkins-hbase4:35999] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.65 KB heapSize=67.61 KB 2023-02-12 06:03:27,803 INFO [M:0;jenkins-hbase4:35999] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.65 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/0c9fe3aefb4947ee93700b2056f432ff 2023-02-12 06:03:27,808 DEBUG [M:0;jenkins-hbase4:35999] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/0c9fe3aefb4947ee93700b2056f432ff as hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/0c9fe3aefb4947ee93700b2056f432ff 2023-02-12 06:03:27,811 INFO [M:0;jenkins-hbase4:35999] regionserver.HStore(1080): Added hdfs://localhost:35831/user/jenkins/test-data/242e505f-c528-f2b0-3d3e-202c91b7ee8d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/0c9fe3aefb4947ee93700b2056f432ff, entries=17, sequenceid=132, filesize=8.7 K 2023-02-12 06:03:27,812 INFO [M:0;jenkins-hbase4:35999] regionserver.HRegion(2947): Finished flush of dataSize ~56.65 KB/58009, heapSize ~67.59 KB/69216, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false 2023-02-12 06:03:27,812 INFO [M:0;jenkins-hbase4:35999] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:27,813 DEBUG [M:0;jenkins-hbase4:35999] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676181807795Disabling compacts and flushes for region at 1676181807795Disabling writes for close at 1676181807795Obtaining lock to block concurrent updates at 1676181807796 (+1 ms)Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676181807796Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=58009, getHeapSize=69216, getOffHeapSize=0, getCellsCount=145 at 1676181807796Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676181807796Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676181807797 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676181807798 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676181807798Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676181807809 (+11 ms)Finished flush of dataSize ~56.65 KB/58009, heapSize ~67.59 KB/69216, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false at 1676181807812 (+3 ms)Writing region close event to WAL at 1676181807812Closed at 1676181807812 2023-02-12 06:03:27,814 INFO [M:0;jenkins-hbase4:35999] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-12 06:03:27,814 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 06:03:27,816 INFO [M:0;jenkins-hbase4:35999] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35999 2023-02-12 06:03:27,817 DEBUG [M:0;jenkins-hbase4:35999] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,35999,1676181804506 already deleted, retry=false 2023-02-12 06:03:28,170 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:03:28,170 INFO [M:0;jenkins-hbase4:35999] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35999,1676181804506; zookeeper connection closed. 2023-02-12 06:03:28,170 ERROR [Listener at localhost/44093-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7a842eca rejected from java.util.concurrent.ThreadPoolExecutor@7ebbb542[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:28,171 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): master:35999-0x10047207f8b0000, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:03:28,171 ERROR [Listener at localhost/44093-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5161cffa rejected from java.util.concurrent.ThreadPoolExecutor@7ebbb542[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:28,270 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): regionserver:41805-0x10047207f8b0001, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:03:28,270 INFO [RS:0;jenkins-hbase4:41805] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41805,1676181804566; zookeeper connection closed. 2023-02-12 06:03:28,270 ERROR [Listener at localhost/44093-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@36cd6c46 rejected from java.util.concurrent.ThreadPoolExecutor@12f741ab[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:28,271 DEBUG [Listener at localhost/44093-EventThread] zookeeper.ZKWatcher(600): regionserver:41805-0x10047207f8b0001, quorum=127.0.0.1:64834, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:03:28,271 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@409c346] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@409c346 2023-02-12 06:03:28,271 ERROR [Listener at localhost/44093-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4eba67cd rejected from java.util.concurrent.ThreadPoolExecutor@12f741ab[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:28,271 INFO [Listener at localhost/44093] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-12 06:03:28,271 WARN [Listener at localhost/44093] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 06:03:28,275 INFO [Listener at localhost/44093] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 06:03:28,376 WARN [BP-427937581-172.31.14.131-1676181803841 heartbeating to localhost/127.0.0.1:35831] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 06:03:28,379 WARN [BP-427937581-172.31.14.131-1676181803841 heartbeating to localhost/127.0.0.1:35831] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-427937581-172.31.14.131-1676181803841 (Datanode Uuid d1237b50-076c-46de-8586-dc6f127b9b24) service to localhost/127.0.0.1:35831 2023-02-12 06:03:28,379 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0b84db20-31ef-af49-185f-b9ab9096ba02/cluster_954cce17-fa99-96fa-d88b-a3ec57b22c1c/dfs/data/data3/current/BP-427937581-172.31.14.131-1676181803841] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 06:03:28,380 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0b84db20-31ef-af49-185f-b9ab9096ba02/cluster_954cce17-fa99-96fa-d88b-a3ec57b22c1c/dfs/data/data4/current/BP-427937581-172.31.14.131-1676181803841] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 06:03:28,381 WARN [Listener at localhost/44093] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 06:03:28,389 INFO [Listener at localhost/44093] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 06:03:28,493 WARN [BP-427937581-172.31.14.131-1676181803841 heartbeating to localhost/127.0.0.1:35831] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 06:03:28,494 WARN [BP-427937581-172.31.14.131-1676181803841 heartbeating to localhost/127.0.0.1:35831] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-427937581-172.31.14.131-1676181803841 (Datanode Uuid c25dd0d9-d2b6-414e-a83e-f28ff10807b3) service to localhost/127.0.0.1:35831 2023-02-12 06:03:28,494 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0b84db20-31ef-af49-185f-b9ab9096ba02/cluster_954cce17-fa99-96fa-d88b-a3ec57b22c1c/dfs/data/data1/current/BP-427937581-172.31.14.131-1676181803841] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 06:03:28,494 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0b84db20-31ef-af49-185f-b9ab9096ba02/cluster_954cce17-fa99-96fa-d88b-a3ec57b22c1c/dfs/data/data2/current/BP-427937581-172.31.14.131-1676181803841] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 06:03:28,503 INFO [Listener at localhost/44093] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 06:03:28,616 INFO [Listener at localhost/44093] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-12 06:03:28,640 INFO [Listener at localhost/44093] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-12 06:03:28,652 INFO [Listener at localhost/44093] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=271 (was 251) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost:35831 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/44093 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:35831 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:35831 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,35999,1676181804506)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:35831 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost:35831 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:35831 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:35831 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=562 (was 653), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=318 (was 329), ProcessCount=166 (was 166), AvailableMemoryMB=4164 (was 4213) 2023-02-12 06:03:28,663 INFO [Listener at localhost/44093] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=271, OpenFileDescriptor=562, MaxFileDescriptor=60000, SystemLoadAverage=318, ProcessCount=166, AvailableMemoryMB=4164 2023-02-12 06:03:28,673 INFO [Listener at localhost/44093] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0b84db20-31ef-af49-185f-b9ab9096ba02/hadoop.log.dir so I do NOT create it in target/test-data/e687fc21-5a6e-91dc-b0d3-6ec9f9eb174b 2023-02-12 06:03:28,673 WARN [Listener at localhost/44093] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0b84db20-31ef-af49-185f-b9ab9096ba02/hadoop.log.dir Erasing configuration value by system value. 2023-02-12 06:03:28,673 INFO [Listener at localhost/44093] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0b84db20-31ef-af49-185f-b9ab9096ba02/hadoop.tmp.dir so I do NOT create it in target/test-data/e687fc21-5a6e-91dc-b0d3-6ec9f9eb174b 2023-02-12 06:03:28,673 WARN [Listener at localhost/44093] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/0b84db20-31ef-af49-185f-b9ab9096ba02/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-12 06:03:28,673 DEBUG [Listener at localhost/44093] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e687fc21-5a6e-91dc-b0d3-6ec9f9eb174b 2023-02-12 06:03:28,674 INFO [Listener at localhost/44093] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-12 06:03:28,674 INFO [Listener at localhost/44093] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e687fc21-5a6e-91dc-b0d3-6ec9f9eb174b/cluster_60f29b24-5f67-db61-c7a2-746bd106df0f, deleteOnExit=true 2023-02-12 06:03:28,674 INFO [Listener at localhost/44093] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-12 06:03:28,674 INFO [Listener at localhost/44093] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e687fc21-5a6e-91dc-b0d3-6ec9f9eb174b/test.cache.data in system properties and HBase conf 2023-02-12 06:03:28,674 INFO [Listener at localhost/44093] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e687fc21-5a6e-91dc-b0d3-6ec9f9eb174b/hadoop.tmp.dir in system properties and HBase conf 2023-02-12 06:03:28,674 INFO [Listener at localhost/44093] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e687fc21-5a6e-91dc-b0d3-6ec9f9eb174b/hadoop.log.dir in system properties and HBase conf 2023-02-12 06:03:28,674 INFO [Listener at localhost/44093] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e687fc21-5a6e-91dc-b0d3-6ec9f9eb174b/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-12 06:03:28,674 INFO [Listener at localhost/44093] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e687fc21-5a6e-91dc-b0d3-6ec9f9eb174b/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-12 06:03:28,674 INFO [Listener at localhost/44093] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-12 06:03:28,674 DEBUG [Listener at localhost/44093] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-12 06:03:28,675 INFO [Listener at localhost/44093] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e687fc21-5a6e-91dc-b0d3-6ec9f9eb174b/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-12 06:03:28,675 INFO [Listener at localhost/44093] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e687fc21-5a6e-91dc-b0d3-6ec9f9eb174b/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-12 06:03:28,675 INFO [Listener at localhost/44093] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e687fc21-5a6e-91dc-b0d3-6ec9f9eb174b/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-12 06:03:28,675 INFO [Listener at localhost/44093] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e687fc21-5a6e-91dc-b0d3-6ec9f9eb174b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 06:03:28,675 INFO [Listener at localhost/44093] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e687fc21-5a6e-91dc-b0d3-6ec9f9eb174b/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-12 06:03:28,675 INFO [Listener at localhost/44093] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e687fc21-5a6e-91dc-b0d3-6ec9f9eb174b/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-12 06:03:28,675 INFO [Listener at localhost/44093] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e687fc21-5a6e-91dc-b0d3-6ec9f9eb174b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 06:03:28,675 INFO [Listener at localhost/44093] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e687fc21-5a6e-91dc-b0d3-6ec9f9eb174b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 06:03:28,675 INFO [Listener at localhost/44093] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e687fc21-5a6e-91dc-b0d3-6ec9f9eb174b/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-12 06:03:28,675 INFO [Listener at localhost/44093] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e687fc21-5a6e-91dc-b0d3-6ec9f9eb174b/nfs.dump.dir in system properties and HBase conf 2023-02-12 06:03:28,676 INFO [Listener at localhost/44093] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e687fc21-5a6e-91dc-b0d3-6ec9f9eb174b/java.io.tmpdir in system properties and HBase conf 2023-02-12 06:03:28,676 INFO [Listener at localhost/44093] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e687fc21-5a6e-91dc-b0d3-6ec9f9eb174b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 06:03:28,676 INFO [Listener at localhost/44093] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e687fc21-5a6e-91dc-b0d3-6ec9f9eb174b/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-12 06:03:28,676 INFO [Listener at localhost/44093] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e687fc21-5a6e-91dc-b0d3-6ec9f9eb174b/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-12 06:03:28,680 WARN [Listener at localhost/44093] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 06:03:28,680 WARN [Listener at localhost/44093] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 06:03:28,719 WARN [Listener at localhost/44093] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 06:03:28,721 INFO [Listener at localhost/44093] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 06:03:28,726 INFO [Listener at localhost/44093] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e687fc21-5a6e-91dc-b0d3-6ec9f9eb174b/java.io.tmpdir/Jetty_localhost_34141_hdfs____.enwxyh/webapp 2023-02-12 06:03:28,818 INFO [Listener at localhost/44093] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34141 2023-02-12 06:03:28,823 WARN [Listener at localhost/44093] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 06:03:28,823 WARN [Listener at localhost/44093] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 06:03:28,858 WARN [Listener at localhost/42309] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 06:03:28,875 WARN [Listener at localhost/42309] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 06:03:28,877 WARN [Listener at localhost/42309] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 06:03:28,878 INFO [Listener at localhost/42309] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 06:03:28,886 INFO [Listener at localhost/42309] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e687fc21-5a6e-91dc-b0d3-6ec9f9eb174b/java.io.tmpdir/Jetty_localhost_38353_datanode____codmcz/webapp 2023-02-12 06:03:28,980 INFO [Listener at localhost/42309] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38353 2023-02-12 06:03:28,992 WARN [Listener at localhost/35935] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 06:03:29,006 WARN [Listener at localhost/35935] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 06:03:29,009 WARN [Listener at localhost/35935] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 06:03:29,010 INFO [Listener at localhost/35935] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 06:03:29,014 INFO [Listener at localhost/35935] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e687fc21-5a6e-91dc-b0d3-6ec9f9eb174b/java.io.tmpdir/Jetty_localhost_34317_datanode____.ajnfk1/webapp 2023-02-12 06:03:29,089 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfeab1033134afb51: Processing first storage report for DS-9e793f68-ade9-4359-b9e7-767cbafe8561 from datanode 6b06b136-49f1-4ae3-9ebb-e70d71797601 2023-02-12 06:03:29,090 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfeab1033134afb51: from storage DS-9e793f68-ade9-4359-b9e7-767cbafe8561 node DatanodeRegistration(127.0.0.1:40925, datanodeUuid=6b06b136-49f1-4ae3-9ebb-e70d71797601, infoPort=45681, infoSecurePort=0, ipcPort=35935, storageInfo=lv=-57;cid=testClusterID;nsid=642690099;c=1676181808682), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-12 06:03:29,090 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfeab1033134afb51: Processing first storage report for DS-5e199182-87c3-44e1-8b89-df47846a860d from datanode 6b06b136-49f1-4ae3-9ebb-e70d71797601 2023-02-12 06:03:29,090 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfeab1033134afb51: from storage DS-5e199182-87c3-44e1-8b89-df47846a860d node DatanodeRegistration(127.0.0.1:40925, datanodeUuid=6b06b136-49f1-4ae3-9ebb-e70d71797601, infoPort=45681, infoSecurePort=0, ipcPort=35935, storageInfo=lv=-57;cid=testClusterID;nsid=642690099;c=1676181808682), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 06:03:29,112 INFO [Listener at localhost/35935] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34317 2023-02-12 06:03:29,124 WARN [Listener at localhost/37311] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 06:03:29,219 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2c71fcd8895ed6f2: Processing first storage report for DS-c689d015-bf89-4dca-be70-84437723d4d0 from datanode e7487037-994b-46a5-96e5-181b07e10252 2023-02-12 06:03:29,219 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2c71fcd8895ed6f2: from storage DS-c689d015-bf89-4dca-be70-84437723d4d0 node DatanodeRegistration(127.0.0.1:34183, datanodeUuid=e7487037-994b-46a5-96e5-181b07e10252, infoPort=41533, infoSecurePort=0, ipcPort=37311, storageInfo=lv=-57;cid=testClusterID;nsid=642690099;c=1676181808682), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 06:03:29,219 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2c71fcd8895ed6f2: Processing first storage report for DS-1d248f55-aee1-4332-938d-d24175fa9e5a from datanode e7487037-994b-46a5-96e5-181b07e10252 2023-02-12 06:03:29,219 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2c71fcd8895ed6f2: from storage DS-1d248f55-aee1-4332-938d-d24175fa9e5a node DatanodeRegistration(127.0.0.1:34183, datanodeUuid=e7487037-994b-46a5-96e5-181b07e10252, infoPort=41533, infoSecurePort=0, ipcPort=37311, storageInfo=lv=-57;cid=testClusterID;nsid=642690099;c=1676181808682), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 06:03:29,233 DEBUG [Listener at localhost/37311] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e687fc21-5a6e-91dc-b0d3-6ec9f9eb174b 2023-02-12 06:03:29,235 INFO [Listener at localhost/37311] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e687fc21-5a6e-91dc-b0d3-6ec9f9eb174b/cluster_60f29b24-5f67-db61-c7a2-746bd106df0f/zookeeper_0, clientPort=50136, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e687fc21-5a6e-91dc-b0d3-6ec9f9eb174b/cluster_60f29b24-5f67-db61-c7a2-746bd106df0f/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e687fc21-5a6e-91dc-b0d3-6ec9f9eb174b/cluster_60f29b24-5f67-db61-c7a2-746bd106df0f/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-12 06:03:29,236 INFO [Listener at localhost/37311] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=50136 2023-02-12 06:03:29,236 INFO [Listener at localhost/37311] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:29,237 INFO [Listener at localhost/37311] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:29,250 INFO [Listener at localhost/37311] util.FSUtils(479): Created version file at hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc with version=8 2023-02-12 06:03:29,250 INFO [Listener at localhost/37311] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:29,251 INFO [Listener at localhost/37311] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:29,252 INFO [Listener at localhost/37311] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:42309/user/jenkins/test-data/e69ac9de-0161-9e0c-e60d-0ea4942db3dd/hbase-staging 2023-02-12 06:03:29,254 INFO [Listener at localhost/37311] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 06:03:29,254 INFO [Listener at localhost/37311] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:29,254 INFO [Listener at localhost/37311] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:29,254 INFO [Listener at localhost/37311] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 06:03:29,254 INFO [Listener at localhost/37311] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:29,254 INFO [Listener at localhost/37311] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 06:03:29,254 INFO [Listener at localhost/37311] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 06:03:29,255 INFO [Listener at localhost/37311] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41405 2023-02-12 06:03:29,255 INFO [Listener at localhost/37311] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:29,256 INFO [Listener at localhost/37311] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:29,257 INFO [Listener at localhost/37311] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41405 connecting to ZooKeeper ensemble=127.0.0.1:50136 2023-02-12 06:03:29,264 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:414050x0, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 06:03:29,268 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:41405-0x100472092180000 connected 2023-02-12 06:03:29,284 DEBUG [Listener at localhost/37311] zookeeper.ZKUtil(164): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 06:03:29,284 DEBUG [Listener at localhost/37311] zookeeper.ZKUtil(164): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:03:29,285 DEBUG [Listener at localhost/37311] zookeeper.ZKUtil(164): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 06:03:29,288 DEBUG [Listener at localhost/37311] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41405 2023-02-12 06:03:29,288 DEBUG [Listener at localhost/37311] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41405 2023-02-12 06:03:29,289 DEBUG [Listener at localhost/37311] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41405 2023-02-12 06:03:29,289 DEBUG [Listener at localhost/37311] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41405 2023-02-12 06:03:29,292 DEBUG [Listener at localhost/37311] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41405 2023-02-12 06:03:29,292 INFO [Listener at localhost/37311] master.HMaster(439): hbase.rootdir=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc, hbase.cluster.distributed=false 2023-02-12 06:03:29,304 INFO [Listener at localhost/37311] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 06:03:29,304 INFO [Listener at localhost/37311] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:29,304 INFO [Listener at localhost/37311] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:29,304 INFO [Listener at localhost/37311] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 06:03:29,305 INFO [Listener at localhost/37311] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:29,305 INFO [Listener at localhost/37311] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 06:03:29,305 INFO [Listener at localhost/37311] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 06:03:29,306 INFO [Listener at localhost/37311] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41881 2023-02-12 06:03:29,306 INFO [Listener at localhost/37311] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 06:03:29,308 DEBUG [Listener at localhost/37311] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:03:29,308 INFO [Listener at localhost/37311] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:29,309 INFO [Listener at localhost/37311] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:29,310 INFO [Listener at localhost/37311] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41881 connecting to ZooKeeper ensemble=127.0.0.1:50136 2023-02-12 06:03:29,312 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): regionserver:418810x0, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 06:03:29,314 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41881-0x100472092180001 connected 2023-02-12 06:03:29,314 DEBUG [Listener at localhost/37311] zookeeper.ZKUtil(164): regionserver:41881-0x100472092180001, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 06:03:29,315 DEBUG [Listener at localhost/37311] zookeeper.ZKUtil(164): regionserver:41881-0x100472092180001, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:03:29,316 DEBUG [Listener at localhost/37311] zookeeper.ZKUtil(164): regionserver:41881-0x100472092180001, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 06:03:29,320 DEBUG [Listener at localhost/37311] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41881 2023-02-12 06:03:29,320 DEBUG [Listener at localhost/37311] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41881 2023-02-12 06:03:29,320 DEBUG [Listener at localhost/37311] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41881 2023-02-12 06:03:29,324 DEBUG [Listener at localhost/37311] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41881 2023-02-12 06:03:29,324 DEBUG [Listener at localhost/37311] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41881 2023-02-12 06:03:29,334 INFO [Listener at localhost/37311] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-12 06:03:29,335 INFO [Listener at localhost/37311] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:29,335 INFO [Listener at localhost/37311] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:29,335 INFO [Listener at localhost/37311] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 06:03:29,335 INFO [Listener at localhost/37311] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 06:03:29,335 INFO [Listener at localhost/37311] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 06:03:29,335 INFO [Listener at localhost/37311] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 06:03:29,336 INFO [Listener at localhost/37311] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36993 2023-02-12 06:03:29,336 INFO [Listener at localhost/37311] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 06:03:29,337 DEBUG [Listener at localhost/37311] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:03:29,337 INFO [Listener at localhost/37311] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:29,338 INFO [Listener at localhost/37311] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:29,339 INFO [Listener at localhost/37311] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36993 connecting to ZooKeeper ensemble=127.0.0.1:50136 2023-02-12 06:03:29,341 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): regionserver:369930x0, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 06:03:29,341 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36993-0x100472092180002 connected 2023-02-12 06:03:29,341 DEBUG [Listener at localhost/37311] zookeeper.ZKUtil(164): regionserver:36993-0x100472092180002, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 06:03:29,342 DEBUG [Listener at localhost/37311] zookeeper.ZKUtil(164): regionserver:36993-0x100472092180002, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:03:29,342 DEBUG [Listener at localhost/37311] zookeeper.ZKUtil(164): regionserver:36993-0x100472092180002, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 06:03:29,344 DEBUG [Listener at localhost/37311] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36993 2023-02-12 06:03:29,345 DEBUG [Listener at localhost/37311] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36993 2023-02-12 06:03:29,348 DEBUG [Listener at localhost/37311] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36993 2023-02-12 06:03:29,348 DEBUG [Listener at localhost/37311] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36993 2023-02-12 06:03:29,348 DEBUG [Listener at localhost/37311] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36993 2023-02-12 06:03:29,350 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,41405,1676181809253 2023-02-12 06:03:29,352 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 06:03:29,352 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,41405,1676181809253 2023-02-12 06:03:29,353 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 06:03:29,353 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): regionserver:36993-0x100472092180002, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 06:03:29,353 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:29,353 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): regionserver:41881-0x100472092180001, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 06:03:29,357 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 06:03:29,357 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 06:03:29,357 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,41405,1676181809253 from backup master directory 2023-02-12 06:03:29,358 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,41405,1676181809253 2023-02-12 06:03:29,358 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 06:03:29,358 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 06:03:29,358 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,41405,1676181809253 2023-02-12 06:03:29,371 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/hbase.id with ID: 84e959bd-23b4-4975-a0e3-522611a8f6f4 2023-02-12 06:03:29,383 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 06:03:29,386 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:29,392 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x2f719db9 to 127.0.0.1:50136 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 06:03:29,397 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6185ea80, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 06:03:29,397 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 06:03:29,398 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-12 06:03:29,398 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 06:03:29,399 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/MasterData/data/master/store-tmp 2023-02-12 06:03:29,405 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:29,405 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 06:03:29,406 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:29,406 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:29,406 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 06:03:29,406 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:29,406 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:29,406 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676181809405Disabling compacts and flushes for region at 1676181809405Disabling writes for close at 1676181809406 (+1 ms)Writing region close event to WAL at 1676181809406Closed at 1676181809406 2023-02-12 06:03:29,406 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/MasterData/WALs/jenkins-hbase4.apache.org,41405,1676181809253 2023-02-12 06:03:29,408 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41405%2C1676181809253, suffix=, logDir=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/MasterData/WALs/jenkins-hbase4.apache.org,41405,1676181809253, archiveDir=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/MasterData/oldWALs, maxLogs=10 2023-02-12 06:03:29,425 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34183,DS-c689d015-bf89-4dca-be70-84437723d4d0,DISK] 2023-02-12 06:03:29,425 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40925,DS-9e793f68-ade9-4359-b9e7-767cbafe8561,DISK] 2023-02-12 06:03:29,427 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/MasterData/WALs/jenkins-hbase4.apache.org,41405,1676181809253/jenkins-hbase4.apache.org%2C41405%2C1676181809253.1676181809408 2023-02-12 06:03:29,427 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34183,DS-c689d015-bf89-4dca-be70-84437723d4d0,DISK], DatanodeInfoWithStorage[127.0.0.1:40925,DS-9e793f68-ade9-4359-b9e7-767cbafe8561,DISK]] 2023-02-12 06:03:29,427 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-12 06:03:29,427 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:29,427 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:03:29,427 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:03:29,432 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:03:29,433 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-12 06:03:29,433 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-12 06:03:29,434 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:29,434 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:03:29,434 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:03:29,436 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 06:03:29,438 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:03:29,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73525079, jitterRate=0.09560905396938324}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 06:03:29,438 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676181809428Initializing all the Stores at 1676181809428Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181809428Cleaning up temporary data from old regions at 1676181809435 (+7 ms)Cleaning up detritus from prior splits at 1676181809435Region opened successfully at 1676181809438 (+3 ms) 2023-02-12 06:03:29,440 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-12 06:03:29,441 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-12 06:03:29,441 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-12 06:03:29,441 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-12 06:03:29,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-12 06:03:29,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-12 06:03:29,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-12 06:03:29,442 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-12 06:03:29,443 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-12 06:03:29,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-12 06:03:29,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-12 06:03:29,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-12 06:03:29,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-12 06:03:29,454 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-12 06:03:29,455 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:29,456 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-12 06:03:29,456 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-12 06:03:29,456 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-12 06:03:29,458 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 06:03:29,458 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): regionserver:41881-0x100472092180001, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 06:03:29,458 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): regionserver:36993-0x100472092180002, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 06:03:29,458 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:29,459 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,41405,1676181809253, sessionid=0x100472092180000, setting cluster-up flag (Was=false) 2023-02-12 06:03:29,466 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:29,469 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-12 06:03:29,470 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41405,1676181809253 2023-02-12 06:03:29,473 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:29,480 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-12 06:03:29,481 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41405,1676181809253 2023-02-12 06:03:29,481 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/.hbase-snapshot/.tmp 2023-02-12 06:03:29,483 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-12 06:03:29,483 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 06:03:29,483 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 06:03:29,483 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 06:03:29,483 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-12 06:03:29,483 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-12 06:03:29,483 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:29,483 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 06:03:29,483 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:29,485 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676181839485 2023-02-12 06:03:29,485 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-12 06:03:29,485 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-12 06:03:29,485 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-12 06:03:29,485 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 06:03:29,485 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-12 06:03:29,485 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-12 06:03:29,485 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-12 06:03:29,486 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-12 06:03:29,486 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:29,486 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-12 06:03:29,486 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-12 06:03:29,486 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-12 06:03:29,487 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 06:03:29,488 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-12 06:03:29,488 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-12 06:03:29,488 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676181809488,5,FailOnTimeoutGroup] 2023-02-12 06:03:29,489 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676181809489,5,FailOnTimeoutGroup] 2023-02-12 06:03:29,489 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:29,489 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-12 06:03:29,489 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:29,489 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:29,494 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 06:03:29,494 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 06:03:29,494 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc 2023-02-12 06:03:29,502 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:29,503 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 06:03:29,504 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/hbase/meta/1588230740/info 2023-02-12 06:03:29,504 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 06:03:29,504 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:29,504 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 06:03:29,505 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/hbase/meta/1588230740/rep_barrier 2023-02-12 06:03:29,506 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 06:03:29,506 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:29,506 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 06:03:29,507 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/hbase/meta/1588230740/table 2023-02-12 06:03:29,507 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 06:03:29,507 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:29,508 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/hbase/meta/1588230740 2023-02-12 06:03:29,508 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/hbase/meta/1588230740 2023-02-12 06:03:29,509 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 06:03:29,510 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 06:03:29,511 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:03:29,511 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63238063, jitterRate=-0.0576794296503067}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 06:03:29,511 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676181809502Initializing all the Stores at 1676181809503 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676181809503Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181809503Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676181809503Cleaning up temporary data from old regions at 1676181809509 (+6 ms)Cleaning up detritus from prior splits at 1676181809509Region opened successfully at 1676181809511 (+2 ms) 2023-02-12 06:03:29,511 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 06:03:29,512 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 06:03:29,512 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 06:03:29,512 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 06:03:29,512 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 06:03:29,512 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 06:03:29,512 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676181809511Disabling compacts and flushes for region at 1676181809511Disabling writes for close at 1676181809512 (+1 ms)Writing region close event to WAL at 1676181809512Closed at 1676181809512 2023-02-12 06:03:29,512 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 06:03:29,512 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-12 06:03:29,513 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-12 06:03:29,515 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-12 06:03:29,516 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-12 06:03:29,550 INFO [RS:1;jenkins-hbase4:36993] regionserver.HRegionServer(952): ClusterId : 84e959bd-23b4-4975-a0e3-522611a8f6f4 2023-02-12 06:03:29,550 INFO [RS:0;jenkins-hbase4:41881] regionserver.HRegionServer(952): ClusterId : 84e959bd-23b4-4975-a0e3-522611a8f6f4 2023-02-12 06:03:29,550 DEBUG [RS:1;jenkins-hbase4:36993] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 06:03:29,550 DEBUG [RS:0;jenkins-hbase4:41881] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 06:03:29,552 DEBUG [RS:0;jenkins-hbase4:41881] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 06:03:29,552 DEBUG [RS:0;jenkins-hbase4:41881] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 06:03:29,552 DEBUG [RS:1;jenkins-hbase4:36993] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 06:03:29,552 DEBUG [RS:1;jenkins-hbase4:36993] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 06:03:29,554 DEBUG [RS:0;jenkins-hbase4:41881] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 06:03:29,555 DEBUG [RS:0;jenkins-hbase4:41881] zookeeper.ReadOnlyZKClient(139): Connect 0x7a1debe1 to 127.0.0.1:50136 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 06:03:29,555 DEBUG [RS:1;jenkins-hbase4:36993] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 06:03:29,556 DEBUG [RS:1;jenkins-hbase4:36993] zookeeper.ReadOnlyZKClient(139): Connect 0x524b5324 to 127.0.0.1:50136 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 06:03:29,559 DEBUG [RS:1;jenkins-hbase4:36993] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c8cb71d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 06:03:29,559 DEBUG [RS:0;jenkins-hbase4:41881] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74da0ad2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 06:03:29,560 DEBUG [RS:1;jenkins-hbase4:36993] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@58b33854, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 06:03:29,560 DEBUG [RS:0;jenkins-hbase4:41881] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70e58091, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 06:03:29,569 DEBUG [RS:0;jenkins-hbase4:41881] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:41881 2023-02-12 06:03:29,569 DEBUG [RS:1;jenkins-hbase4:36993] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:36993 2023-02-12 06:03:29,569 INFO [RS:0;jenkins-hbase4:41881] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 06:03:29,569 INFO [RS:0;jenkins-hbase4:41881] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 06:03:29,569 INFO [RS:1;jenkins-hbase4:36993] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 06:03:29,569 INFO [RS:1;jenkins-hbase4:36993] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 06:03:29,569 DEBUG [RS:0;jenkins-hbase4:41881] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 06:03:29,569 DEBUG [RS:1;jenkins-hbase4:36993] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 06:03:29,569 INFO [RS:0;jenkins-hbase4:41881] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41405,1676181809253 with isa=jenkins-hbase4.apache.org/172.31.14.131:41881, startcode=1676181809304 2023-02-12 06:03:29,569 INFO [RS:1;jenkins-hbase4:36993] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41405,1676181809253 with isa=jenkins-hbase4.apache.org/172.31.14.131:36993, startcode=1676181809334 2023-02-12 06:03:29,569 DEBUG [RS:0;jenkins-hbase4:41881] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 06:03:29,570 DEBUG [RS:1;jenkins-hbase4:36993] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 06:03:29,571 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41929, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 06:03:29,571 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54129, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 06:03:29,573 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41405] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:29,573 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41881,1676181809304 2023-02-12 06:03:29,573 DEBUG [RS:0;jenkins-hbase4:41881] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc 2023-02-12 06:03:29,573 DEBUG [RS:1;jenkins-hbase4:36993] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc 2023-02-12 06:03:29,573 DEBUG [RS:0;jenkins-hbase4:41881] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:42309 2023-02-12 06:03:29,574 DEBUG [RS:1;jenkins-hbase4:36993] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:42309 2023-02-12 06:03:29,574 DEBUG [RS:0;jenkins-hbase4:41881] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 06:03:29,574 DEBUG [RS:1;jenkins-hbase4:36993] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 06:03:29,577 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 06:03:29,578 DEBUG [RS:1;jenkins-hbase4:36993] zookeeper.ZKUtil(162): regionserver:36993-0x100472092180002, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:29,578 DEBUG [RS:0;jenkins-hbase4:41881] zookeeper.ZKUtil(162): regionserver:41881-0x100472092180001, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41881,1676181809304 2023-02-12 06:03:29,578 WARN [RS:1;jenkins-hbase4:36993] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 06:03:29,578 WARN [RS:0;jenkins-hbase4:41881] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 06:03:29,578 INFO [RS:1;jenkins-hbase4:36993] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 06:03:29,578 INFO [RS:0;jenkins-hbase4:41881] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 06:03:29,579 DEBUG [RS:1;jenkins-hbase4:36993] regionserver.HRegionServer(1947): logDir=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/WALs/jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:29,579 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36993,1676181809334] 2023-02-12 06:03:29,579 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41881,1676181809304] 2023-02-12 06:03:29,579 DEBUG [RS:0;jenkins-hbase4:41881] regionserver.HRegionServer(1947): logDir=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/WALs/jenkins-hbase4.apache.org,41881,1676181809304 2023-02-12 06:03:29,584 DEBUG [RS:1;jenkins-hbase4:36993] zookeeper.ZKUtil(162): regionserver:36993-0x100472092180002, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41881,1676181809304 2023-02-12 06:03:29,584 DEBUG [RS:0;jenkins-hbase4:41881] zookeeper.ZKUtil(162): regionserver:41881-0x100472092180001, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41881,1676181809304 2023-02-12 06:03:29,584 DEBUG [RS:1;jenkins-hbase4:36993] zookeeper.ZKUtil(162): regionserver:36993-0x100472092180002, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:29,584 DEBUG [RS:0;jenkins-hbase4:41881] zookeeper.ZKUtil(162): regionserver:41881-0x100472092180001, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:29,585 DEBUG [RS:0;jenkins-hbase4:41881] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 06:03:29,585 DEBUG [RS:1;jenkins-hbase4:36993] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 06:03:29,585 INFO [RS:0;jenkins-hbase4:41881] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 06:03:29,585 INFO [RS:1;jenkins-hbase4:36993] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 06:03:29,586 INFO [RS:0;jenkins-hbase4:41881] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 06:03:29,586 INFO [RS:0;jenkins-hbase4:41881] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 06:03:29,586 INFO [RS:0;jenkins-hbase4:41881] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:29,586 INFO [RS:0;jenkins-hbase4:41881] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 06:03:29,590 INFO [RS:0;jenkins-hbase4:41881] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:29,592 INFO [RS:1;jenkins-hbase4:36993] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 06:03:29,592 DEBUG [RS:0;jenkins-hbase4:41881] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:29,592 DEBUG [RS:0;jenkins-hbase4:41881] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:29,592 DEBUG [RS:0;jenkins-hbase4:41881] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:29,592 DEBUG [RS:0;jenkins-hbase4:41881] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:29,593 DEBUG [RS:0;jenkins-hbase4:41881] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:29,593 INFO [RS:1;jenkins-hbase4:36993] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 06:03:29,593 DEBUG [RS:0;jenkins-hbase4:41881] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 06:03:29,593 INFO [RS:1;jenkins-hbase4:36993] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:29,593 DEBUG [RS:0;jenkins-hbase4:41881] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:29,593 DEBUG [RS:0;jenkins-hbase4:41881] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:29,593 DEBUG [RS:0;jenkins-hbase4:41881] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:29,593 DEBUG [RS:0;jenkins-hbase4:41881] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:29,594 INFO [RS:1;jenkins-hbase4:36993] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 06:03:29,595 INFO [RS:0;jenkins-hbase4:41881] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:29,595 INFO [RS:0;jenkins-hbase4:41881] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:29,595 INFO [RS:0;jenkins-hbase4:41881] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:29,596 INFO [RS:1;jenkins-hbase4:36993] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:29,597 DEBUG [RS:1;jenkins-hbase4:36993] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:29,597 DEBUG [RS:1;jenkins-hbase4:36993] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:29,597 DEBUG [RS:1;jenkins-hbase4:36993] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:29,597 DEBUG [RS:1;jenkins-hbase4:36993] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:29,597 DEBUG [RS:1;jenkins-hbase4:36993] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:29,597 DEBUG [RS:1;jenkins-hbase4:36993] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-12 06:03:29,597 DEBUG [RS:1;jenkins-hbase4:36993] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:29,597 DEBUG [RS:1;jenkins-hbase4:36993] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:29,597 DEBUG [RS:1;jenkins-hbase4:36993] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:29,597 DEBUG [RS:1;jenkins-hbase4:36993] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-12 06:03:29,604 INFO [RS:1;jenkins-hbase4:36993] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:29,604 INFO [RS:1;jenkins-hbase4:36993] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:29,604 INFO [RS:1;jenkins-hbase4:36993] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:29,617 INFO [RS:0;jenkins-hbase4:41881] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 06:03:29,617 INFO [RS:0;jenkins-hbase4:41881] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41881,1676181809304-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:29,619 INFO [RS:1;jenkins-hbase4:36993] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 06:03:29,619 INFO [RS:1;jenkins-hbase4:36993] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36993,1676181809334-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:29,628 INFO [RS:0;jenkins-hbase4:41881] regionserver.Replication(203): jenkins-hbase4.apache.org,41881,1676181809304 started 2023-02-12 06:03:29,628 INFO [RS:0;jenkins-hbase4:41881] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,41881,1676181809304, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41881, sessionid=0x100472092180001 2023-02-12 06:03:29,628 DEBUG [RS:0;jenkins-hbase4:41881] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 06:03:29,628 DEBUG [RS:0;jenkins-hbase4:41881] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41881,1676181809304 2023-02-12 06:03:29,628 DEBUG [RS:0;jenkins-hbase4:41881] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41881,1676181809304' 2023-02-12 06:03:29,628 DEBUG [RS:0;jenkins-hbase4:41881] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:03:29,628 DEBUG [RS:0;jenkins-hbase4:41881] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:03:29,629 DEBUG [RS:0;jenkins-hbase4:41881] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 06:03:29,629 DEBUG [RS:0;jenkins-hbase4:41881] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 06:03:29,629 DEBUG [RS:0;jenkins-hbase4:41881] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41881,1676181809304 2023-02-12 06:03:29,629 DEBUG [RS:0;jenkins-hbase4:41881] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41881,1676181809304' 2023-02-12 06:03:29,629 DEBUG [RS:0;jenkins-hbase4:41881] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:03:29,629 DEBUG [RS:0;jenkins-hbase4:41881] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:03:29,629 DEBUG [RS:0;jenkins-hbase4:41881] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 06:03:29,629 INFO [RS:1;jenkins-hbase4:36993] regionserver.Replication(203): jenkins-hbase4.apache.org,36993,1676181809334 started 2023-02-12 06:03:29,629 INFO [RS:0;jenkins-hbase4:41881] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 06:03:29,629 INFO [RS:0;jenkins-hbase4:41881] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 06:03:29,629 INFO [RS:1;jenkins-hbase4:36993] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,36993,1676181809334, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36993, sessionid=0x100472092180002 2023-02-12 06:03:29,630 DEBUG [RS:1;jenkins-hbase4:36993] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 06:03:29,630 DEBUG [RS:1;jenkins-hbase4:36993] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:29,630 DEBUG [RS:1;jenkins-hbase4:36993] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36993,1676181809334' 2023-02-12 06:03:29,630 DEBUG [RS:1;jenkins-hbase4:36993] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:03:29,630 DEBUG [RS:1;jenkins-hbase4:36993] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:03:29,630 DEBUG [RS:1;jenkins-hbase4:36993] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 06:03:29,630 DEBUG [RS:1;jenkins-hbase4:36993] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 06:03:29,630 DEBUG [RS:1;jenkins-hbase4:36993] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:29,630 DEBUG [RS:1;jenkins-hbase4:36993] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36993,1676181809334' 2023-02-12 06:03:29,630 DEBUG [RS:1;jenkins-hbase4:36993] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:03:29,631 DEBUG [RS:1;jenkins-hbase4:36993] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:03:29,631 DEBUG [RS:1;jenkins-hbase4:36993] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 06:03:29,631 INFO [RS:1;jenkins-hbase4:36993] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 06:03:29,631 INFO [RS:1;jenkins-hbase4:36993] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 06:03:29,666 DEBUG [jenkins-hbase4:41405] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-12 06:03:29,667 DEBUG [jenkins-hbase4:41405] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 06:03:29,668 DEBUG [jenkins-hbase4:41405] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 06:03:29,668 DEBUG [jenkins-hbase4:41405] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 06:03:29,668 DEBUG [jenkins-hbase4:41405] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 06:03:29,668 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41881,1676181809304, state=OPENING 2023-02-12 06:03:29,670 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-12 06:03:29,671 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:29,671 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41881,1676181809304}] 2023-02-12 06:03:29,671 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 06:03:29,826 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41881,1676181809304 2023-02-12 06:03:29,826 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 06:03:29,828 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36520, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 06:03:29,832 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-12 06:03:29,832 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 06:03:29,833 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41881%2C1676181809304.meta, suffix=.meta, logDir=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/WALs/jenkins-hbase4.apache.org,41881,1676181809304, archiveDir=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/oldWALs, maxLogs=32 2023-02-12 06:03:29,851 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34183,DS-c689d015-bf89-4dca-be70-84437723d4d0,DISK] 2023-02-12 06:03:29,852 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40925,DS-9e793f68-ade9-4359-b9e7-767cbafe8561,DISK] 2023-02-12 06:03:29,856 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/WALs/jenkins-hbase4.apache.org,41881,1676181809304/jenkins-hbase4.apache.org%2C41881%2C1676181809304.meta.1676181809833.meta 2023-02-12 06:03:29,856 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40925,DS-9e793f68-ade9-4359-b9e7-767cbafe8561,DISK], DatanodeInfoWithStorage[127.0.0.1:34183,DS-c689d015-bf89-4dca-be70-84437723d4d0,DISK]] 2023-02-12 06:03:29,856 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-12 06:03:29,857 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-12 06:03:29,857 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-12 06:03:29,857 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-12 06:03:29,857 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-12 06:03:29,857 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:29,857 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-12 06:03:29,857 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-12 06:03:29,861 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 06:03:29,862 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/hbase/meta/1588230740/info 2023-02-12 06:03:29,862 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/hbase/meta/1588230740/info 2023-02-12 06:03:29,862 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 06:03:29,863 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:29,863 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 06:03:29,864 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/hbase/meta/1588230740/rep_barrier 2023-02-12 06:03:29,864 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/hbase/meta/1588230740/rep_barrier 2023-02-12 06:03:29,864 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 06:03:29,865 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:29,865 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 06:03:29,866 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/hbase/meta/1588230740/table 2023-02-12 06:03:29,866 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/hbase/meta/1588230740/table 2023-02-12 06:03:29,866 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 06:03:29,867 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:29,867 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/hbase/meta/1588230740 2023-02-12 06:03:29,868 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/hbase/meta/1588230740 2023-02-12 06:03:29,870 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 06:03:29,871 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 06:03:29,872 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68938637, jitterRate=0.027265742421150208}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 06:03:29,872 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676181809857Writing region info on filesystem at 1676181809857Initializing all the Stores at 1676181809860 (+3 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676181809860Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181809860Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676181809860Cleaning up temporary data from old regions at 1676181809869 (+9 ms)Cleaning up detritus from prior splits at 1676181809869Running coprocessor post-open hooks at 1676181809872 (+3 ms)Region opened successfully at 1676181809872 2023-02-12 06:03:29,873 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676181809826 2023-02-12 06:03:29,876 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-12 06:03:29,878 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-12 06:03:29,878 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41881,1676181809304, state=OPEN 2023-02-12 06:03:29,879 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-12 06:03:29,879 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 06:03:29,881 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-12 06:03:29,881 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41881,1676181809304 in 208 msec 2023-02-12 06:03:29,882 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-12 06:03:29,882 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 368 msec 2023-02-12 06:03:29,883 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 401 msec 2023-02-12 06:03:29,884 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676181809352, completionTime=-1 2023-02-12 06:03:29,884 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-12 06:03:29,884 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-12 06:03:29,887 DEBUG [hconnection-0x65a80394-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 06:03:29,889 INFO [RS-EventLoopGroup-22-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36526, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 06:03:29,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-12 06:03:29,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676181869890 2023-02-12 06:03:29,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676181929890 2023-02-12 06:03:29,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-12 06:03:29,902 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41405,1676181809253-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:29,902 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41405,1676181809253-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:29,902 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41405,1676181809253-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:29,902 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:41405, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:29,902 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-12 06:03:29,902 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-12 06:03:29,902 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 06:03:29,903 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-12 06:03:29,905 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 06:03:29,905 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-12 06:03:29,905 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 06:03:29,907 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/.tmp/data/hbase/namespace/e9813399069108a418462390e67932c4 2023-02-12 06:03:29,907 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/.tmp/data/hbase/namespace/e9813399069108a418462390e67932c4 empty. 2023-02-12 06:03:29,908 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/.tmp/data/hbase/namespace/e9813399069108a418462390e67932c4 2023-02-12 06:03:29,908 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-12 06:03:29,951 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-12 06:03:29,953 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => e9813399069108a418462390e67932c4, NAME => 'hbase:namespace,,1676181809902.e9813399069108a418462390e67932c4.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/.tmp 2023-02-12 06:03:29,975 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676181809902.e9813399069108a418462390e67932c4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:29,975 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing e9813399069108a418462390e67932c4, disabling compactions & flushes 2023-02-12 06:03:29,975 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676181809902.e9813399069108a418462390e67932c4. 2023-02-12 06:03:29,975 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676181809902.e9813399069108a418462390e67932c4. 2023-02-12 06:03:29,975 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676181809902.e9813399069108a418462390e67932c4. after waiting 0 ms 2023-02-12 06:03:29,975 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676181809902.e9813399069108a418462390e67932c4. 2023-02-12 06:03:29,975 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676181809902.e9813399069108a418462390e67932c4. 2023-02-12 06:03:29,975 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for e9813399069108a418462390e67932c4: Waiting for close lock at 1676181809975Disabling compacts and flushes for region at 1676181809975Disabling writes for close at 1676181809975Writing region close event to WAL at 1676181809975Closed at 1676181809975 2023-02-12 06:03:29,978 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 06:03:29,979 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676181809902.e9813399069108a418462390e67932c4.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676181809979"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181809979"}]},"ts":"1676181809979"} 2023-02-12 06:03:29,981 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 06:03:29,982 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 06:03:29,982 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676181809982"}]},"ts":"1676181809982"} 2023-02-12 06:03:29,984 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-12 06:03:29,987 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 06:03:29,988 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 06:03:29,988 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 06:03:29,988 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 06:03:29,988 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e9813399069108a418462390e67932c4, ASSIGN}] 2023-02-12 06:03:29,991 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e9813399069108a418462390e67932c4, ASSIGN 2023-02-12 06:03:29,992 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=e9813399069108a418462390e67932c4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41881,1676181809304; forceNewPlan=false, retain=false 2023-02-12 06:03:30,142 INFO [jenkins-hbase4:41405] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 06:03:30,143 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e9813399069108a418462390e67932c4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41881,1676181809304 2023-02-12 06:03:30,143 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676181809902.e9813399069108a418462390e67932c4.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676181810143"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181810143"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181810143"}]},"ts":"1676181810143"} 2023-02-12 06:03:30,144 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure e9813399069108a418462390e67932c4, server=jenkins-hbase4.apache.org,41881,1676181809304}] 2023-02-12 06:03:30,299 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676181809902.e9813399069108a418462390e67932c4. 2023-02-12 06:03:30,300 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41881%2C1676181809304, suffix=, logDir=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/WALs/jenkins-hbase4.apache.org,41881,1676181809304, archiveDir=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/oldWALs, maxLogs=32 2023-02-12 06:03:30,314 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40925,DS-9e793f68-ade9-4359-b9e7-767cbafe8561,DISK] 2023-02-12 06:03:30,314 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34183,DS-c689d015-bf89-4dca-be70-84437723d4d0,DISK] 2023-02-12 06:03:30,316 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/WALs/jenkins-hbase4.apache.org,41881,1676181809304/jenkins-hbase4.apache.org%2C41881%2C1676181809304.1676181810300 2023-02-12 06:03:30,316 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40925,DS-9e793f68-ade9-4359-b9e7-767cbafe8561,DISK], DatanodeInfoWithStorage[127.0.0.1:34183,DS-c689d015-bf89-4dca-be70-84437723d4d0,DISK]] 2023-02-12 06:03:30,316 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e9813399069108a418462390e67932c4, NAME => 'hbase:namespace,,1676181809902.e9813399069108a418462390e67932c4.', STARTKEY => '', ENDKEY => ''} 2023-02-12 06:03:30,316 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace e9813399069108a418462390e67932c4 2023-02-12 06:03:30,316 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676181809902.e9813399069108a418462390e67932c4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:30,316 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e9813399069108a418462390e67932c4 2023-02-12 06:03:30,316 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e9813399069108a418462390e67932c4 2023-02-12 06:03:30,320 INFO [StoreOpener-e9813399069108a418462390e67932c4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e9813399069108a418462390e67932c4 2023-02-12 06:03:30,321 DEBUG [StoreOpener-e9813399069108a418462390e67932c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/hbase/namespace/e9813399069108a418462390e67932c4/info 2023-02-12 06:03:30,321 DEBUG [StoreOpener-e9813399069108a418462390e67932c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/hbase/namespace/e9813399069108a418462390e67932c4/info 2023-02-12 06:03:30,321 INFO [StoreOpener-e9813399069108a418462390e67932c4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e9813399069108a418462390e67932c4 columnFamilyName info 2023-02-12 06:03:30,322 INFO [StoreOpener-e9813399069108a418462390e67932c4-1] regionserver.HStore(310): Store=e9813399069108a418462390e67932c4/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:30,322 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/hbase/namespace/e9813399069108a418462390e67932c4 2023-02-12 06:03:30,322 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/hbase/namespace/e9813399069108a418462390e67932c4 2023-02-12 06:03:30,324 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e9813399069108a418462390e67932c4 2023-02-12 06:03:30,328 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/hbase/namespace/e9813399069108a418462390e67932c4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:03:30,329 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e9813399069108a418462390e67932c4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61906090, jitterRate=-0.07752737402915955}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 06:03:30,329 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e9813399069108a418462390e67932c4: Running coprocessor pre-open hook at 1676181810316Writing region info on filesystem at 1676181810316Initializing all the Stores at 1676181810317 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676181810317Cleaning up temporary data from old regions at 1676181810323 (+6 ms)Cleaning up detritus from prior splits at 1676181810323Running coprocessor post-open hooks at 1676181810329 (+6 ms)Region opened successfully at 1676181810329 2023-02-12 06:03:30,329 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676181809902.e9813399069108a418462390e67932c4., pid=6, masterSystemTime=1676181810296 2023-02-12 06:03:30,331 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676181809902.e9813399069108a418462390e67932c4. 2023-02-12 06:03:30,331 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676181809902.e9813399069108a418462390e67932c4. 2023-02-12 06:03:30,331 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e9813399069108a418462390e67932c4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41881,1676181809304 2023-02-12 06:03:30,331 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676181809902.e9813399069108a418462390e67932c4.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676181810331"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676181810331"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676181810331"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676181810331"}]},"ts":"1676181810331"} 2023-02-12 06:03:30,333 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-12 06:03:30,333 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure e9813399069108a418462390e67932c4, server=jenkins-hbase4.apache.org,41881,1676181809304 in 188 msec 2023-02-12 06:03:30,335 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-12 06:03:30,335 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=e9813399069108a418462390e67932c4, ASSIGN in 345 msec 2023-02-12 06:03:30,335 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 06:03:30,335 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676181810335"}]},"ts":"1676181810335"} 2023-02-12 06:03:30,336 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-12 06:03:30,339 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 06:03:30,340 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 437 msec 2023-02-12 06:03:30,404 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-12 06:03:30,405 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-12 06:03:30,406 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:30,413 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-12 06:03:30,420 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 06:03:30,423 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-12 06:03:30,426 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-12 06:03:30,435 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 06:03:30,439 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 14 msec 2023-02-12 06:03:30,450 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-12 06:03:30,454 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-12 06:03:30,454 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.096sec 2023-02-12 06:03:30,454 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-12 06:03:30,454 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-12 06:03:30,454 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-12 06:03:30,454 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41405,1676181809253-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-12 06:03:30,454 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41405,1676181809253-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-12 06:03:30,455 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-12 06:03:30,551 DEBUG [Listener at localhost/37311] zookeeper.ReadOnlyZKClient(139): Connect 0x54056a68 to 127.0.0.1:50136 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 06:03:30,576 DEBUG [Listener at localhost/37311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1bcc09e0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 06:03:30,578 DEBUG [hconnection-0x71192e5b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 06:03:30,580 INFO [RS-EventLoopGroup-22-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36530, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 06:03:30,581 INFO [Listener at localhost/37311] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,41405,1676181809253 2023-02-12 06:03:30,581 DEBUG [Listener at localhost/37311] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-12 06:03:30,583 DEBUG [Listener at localhost/37311] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 06:03:30,585 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44766, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 06:03:30,585 INFO [Listener at localhost/37311] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-12 06:03:30,586 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-12 06:03:30,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-12 06:03:30,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 76 connection: 172.31.14.131:44766 deadline: 1676181870586, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-12 06:03:30,586 INFO [Listener at localhost/37311] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-12 06:03:30,589 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 06:03:30,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-12 06:03:30,592 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 06:03:30,592 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-12 06:03:30,593 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 06:03:30,594 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/.tmp/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497 2023-02-12 06:03:30,595 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/.tmp/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497 empty. 2023-02-12 06:03:30,595 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/.tmp/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497 2023-02-12 06:03:30,595 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-12 06:03:30,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 06:03:30,619 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-12 06:03:30,620 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => e86836a77166f5b0251a695ecae49497, NAME => 'testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/.tmp 2023-02-12 06:03:30,622 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-12 06:03:30,632 INFO [RS:1;jenkins-hbase4:36993] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36993%2C1676181809334, suffix=, logDir=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/WALs/jenkins-hbase4.apache.org,36993,1676181809334, archiveDir=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/oldWALs, maxLogs=32 2023-02-12 06:03:30,658 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34183,DS-c689d015-bf89-4dca-be70-84437723d4d0,DISK] 2023-02-12 06:03:30,658 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40925,DS-9e793f68-ade9-4359-b9e7-767cbafe8561,DISK] 2023-02-12 06:03:30,663 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:30,663 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing e86836a77166f5b0251a695ecae49497, disabling compactions & flushes 2023-02-12 06:03:30,663 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497. 2023-02-12 06:03:30,663 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497. 2023-02-12 06:03:30,663 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497. after waiting 0 ms 2023-02-12 06:03:30,663 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497. 2023-02-12 06:03:30,663 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497. 2023-02-12 06:03:30,663 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for e86836a77166f5b0251a695ecae49497: Waiting for close lock at 1676181810663Disabling compacts and flushes for region at 1676181810663Disabling writes for close at 1676181810663Writing region close event to WAL at 1676181810663Closed at 1676181810663 2023-02-12 06:03:30,666 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 06:03:30,667 INFO [RS:1;jenkins-hbase4:36993] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/WALs/jenkins-hbase4.apache.org,36993,1676181809334/jenkins-hbase4.apache.org%2C36993%2C1676181809334.1676181810633 2023-02-12 06:03:30,668 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676181810667"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181810667"}]},"ts":"1676181810667"} 2023-02-12 06:03:30,669 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 06:03:30,670 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 06:03:30,670 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676181810670"}]},"ts":"1676181810670"} 2023-02-12 06:03:30,671 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-12 06:03:30,673 DEBUG [RS:1;jenkins-hbase4:36993] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34183,DS-c689d015-bf89-4dca-be70-84437723d4d0,DISK], DatanodeInfoWithStorage[127.0.0.1:40925,DS-9e793f68-ade9-4359-b9e7-767cbafe8561,DISK]] 2023-02-12 06:03:30,679 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-12 06:03:30,680 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-12 06:03:30,680 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-12 06:03:30,680 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-12 06:03:30,680 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e86836a77166f5b0251a695ecae49497, ASSIGN}] 2023-02-12 06:03:30,683 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e86836a77166f5b0251a695ecae49497, ASSIGN 2023-02-12 06:03:30,684 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e86836a77166f5b0251a695ecae49497, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36993,1676181809334; forceNewPlan=false, retain=false 2023-02-12 06:03:30,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 06:03:30,834 INFO [jenkins-hbase4:41405] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-12 06:03:30,834 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=e86836a77166f5b0251a695ecae49497, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:30,835 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676181810834"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181810834"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181810834"}]},"ts":"1676181810834"} 2023-02-12 06:03:30,836 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure e86836a77166f5b0251a695ecae49497, server=jenkins-hbase4.apache.org,36993,1676181809334}] 2023-02-12 06:03:30,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 06:03:30,988 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:30,989 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 06:03:30,990 INFO [RS-EventLoopGroup-23-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58506, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 06:03:30,993 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497. 2023-02-12 06:03:30,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e86836a77166f5b0251a695ecae49497, NAME => 'testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497.', STARTKEY => '', ENDKEY => ''} 2023-02-12 06:03:30,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e86836a77166f5b0251a695ecae49497 2023-02-12 06:03:30,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:30,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e86836a77166f5b0251a695ecae49497 2023-02-12 06:03:30,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e86836a77166f5b0251a695ecae49497 2023-02-12 06:03:30,995 INFO [StoreOpener-e86836a77166f5b0251a695ecae49497-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e86836a77166f5b0251a695ecae49497 2023-02-12 06:03:30,996 DEBUG [StoreOpener-e86836a77166f5b0251a695ecae49497-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/f1 2023-02-12 06:03:30,996 DEBUG [StoreOpener-e86836a77166f5b0251a695ecae49497-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/f1 2023-02-12 06:03:30,997 INFO [StoreOpener-e86836a77166f5b0251a695ecae49497-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e86836a77166f5b0251a695ecae49497 columnFamilyName f1 2023-02-12 06:03:30,997 INFO [StoreOpener-e86836a77166f5b0251a695ecae49497-1] regionserver.HStore(310): Store=e86836a77166f5b0251a695ecae49497/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:30,997 INFO [StoreOpener-e86836a77166f5b0251a695ecae49497-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e86836a77166f5b0251a695ecae49497 2023-02-12 06:03:30,998 DEBUG [StoreOpener-e86836a77166f5b0251a695ecae49497-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/f2 2023-02-12 06:03:30,998 DEBUG [StoreOpener-e86836a77166f5b0251a695ecae49497-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/f2 2023-02-12 06:03:30,999 INFO [StoreOpener-e86836a77166f5b0251a695ecae49497-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e86836a77166f5b0251a695ecae49497 columnFamilyName f2 2023-02-12 06:03:30,999 INFO [StoreOpener-e86836a77166f5b0251a695ecae49497-1] regionserver.HStore(310): Store=e86836a77166f5b0251a695ecae49497/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:31,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497 2023-02-12 06:03:31,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497 2023-02-12 06:03:31,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:03:31,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e86836a77166f5b0251a695ecae49497 2023-02-12 06:03:31,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 06:03:31,010 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e86836a77166f5b0251a695ecae49497; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70185178, jitterRate=0.04584065079689026}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:03:31,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e86836a77166f5b0251a695ecae49497: Running coprocessor pre-open hook at 1676181810994Writing region info on filesystem at 1676181810994Initializing all the Stores at 1676181810995 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181810995Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181810995Cleaning up temporary data from old regions at 1676181811001 (+6 ms)Cleaning up detritus from prior splits at 1676181811001Running coprocessor post-open hooks at 1676181811010 (+9 ms)Region opened successfully at 1676181811010 2023-02-12 06:03:31,011 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497., pid=12, masterSystemTime=1676181810988 2023-02-12 06:03:31,015 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=e86836a77166f5b0251a695ecae49497, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:31,015 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676181811015"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676181811015"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676181811015"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676181811015"}]},"ts":"1676181811015"} 2023-02-12 06:03:31,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497. 2023-02-12 06:03:31,020 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497. 2023-02-12 06:03:31,021 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-12 06:03:31,021 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure e86836a77166f5b0251a695ecae49497, server=jenkins-hbase4.apache.org,36993,1676181809334 in 184 msec 2023-02-12 06:03:31,022 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-12 06:03:31,022 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e86836a77166f5b0251a695ecae49497, ASSIGN in 341 msec 2023-02-12 06:03:31,023 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 06:03:31,023 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676181811023"}]},"ts":"1676181811023"} 2023-02-12 06:03:31,024 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-12 06:03:31,026 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 06:03:31,028 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 437 msec 2023-02-12 06:03:31,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-12 06:03:31,211 INFO [Listener at localhost/37311] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-12 06:03:31,212 DEBUG [Listener at localhost/37311] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-12 06:03:31,212 INFO [Listener at localhost/37311] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 06:03:31,216 INFO [Listener at localhost/37311] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-12 06:03:31,217 INFO [Listener at localhost/37311] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 06:03:31,217 INFO [Listener at localhost/37311] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-12 06:03:31,217 INFO [Listener at localhost/37311] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-12 06:03:31,238 DEBUG [hconnection-0x71192e5b-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 06:03:31,254 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58508, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 06:03:31,266 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36993] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497. 2023-02-12 06:03:31,394 INFO [Listener at localhost/37311] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-12 06:03:31,394 INFO [Listener at localhost/37311] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-12 06:03:31,395 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 06:03:31,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676181811395 (current time:1676181811395). 2023-02-12 06:03:31,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-12 06:03:31,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] zookeeper.ReadOnlyZKClient(139): Connect 0x7273b771 to 127.0.0.1:50136 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 06:03:31,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37345400, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 06:03:31,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 06:03:31,415 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36542, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 06:03:31,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7273b771 to 127.0.0.1:50136 2023-02-12 06:03:31,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:31,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-12 06:03:31,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 06:03:31,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 06:03:31,421 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 06:03:31,422 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676182411422 2023-02-12 06:03:31,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-12 06:03:31,427 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-12 06:03:31,431 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-12 06:03:31,431 DEBUG [Listener at localhost/37311] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-12 06:03:31,431 DEBUG [Listener at localhost/37311] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-12 06:03:31,432 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 12 msec 2023-02-12 06:03:31,433 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 06:03:31,434 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 06:03:31,435 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676182411435 2023-02-12 06:03:31,468 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-12 06:03:31,468 INFO [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-12 06:03:31,468 DEBUG [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 06:03:31,470 DEBUG [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-12 06:03:31,470 DEBUG [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-12 06:03:31,541 DEBUG [Listener at localhost/37311] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 06:03:31,542 DEBUG [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 06:03:31,542 DEBUG [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-12 06:03:31,546 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): regionserver:41881-0x100472092180001, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 06:03:31,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 06:03:31,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 06:03:31,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:03:31,546 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): regionserver:36993-0x100472092180002, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 06:03:31,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 06:03:31,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:03:31,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 06:03:31,546 DEBUG [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:31,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-12 06:03:31,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-12 06:03:31,547 DEBUG [Listener at localhost/37311] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-12 06:03:31,547 DEBUG [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:31,547 DEBUG [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 06:03:31,548 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41881-0x100472092180001, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 06:03:31,548 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36993-0x100472092180002, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 06:03:31,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-12 06:03:31,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-12 06:03:31,548 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-12 06:03:31,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-12 06:03:31,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-12 06:03:31,549 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-12 06:03:31,554 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-12 06:03:31,561 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-12 06:03:31,565 DEBUG [member: 'jenkins-hbase4.apache.org,41881,1676181809304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-12 06:03:31,566 DEBUG [member: 'jenkins-hbase4.apache.org,41881,1676181809304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 06:03:31,569 DEBUG [member: 'jenkins-hbase4.apache.org,41881,1676181809304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-12 06:03:31,570 DEBUG [member: 'jenkins-hbase4.apache.org,41881,1676181809304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-12 06:03:31,570 DEBUG [member: 'jenkins-hbase4.apache.org,41881,1676181809304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41881,1676181809304' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-12 06:03:31,572 DEBUG [member: 'jenkins-hbase4.apache.org,36993,1676181809334' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-12 06:03:31,572 DEBUG [member: 'jenkins-hbase4.apache.org,36993,1676181809334' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 06:03:31,575 DEBUG [member: 'jenkins-hbase4.apache.org,36993,1676181809334' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-12 06:03:31,575 DEBUG [member: 'jenkins-hbase4.apache.org,36993,1676181809334' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-12 06:03:31,575 DEBUG [member: 'jenkins-hbase4.apache.org,36993,1676181809334' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36993,1676181809334' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-12 06:03:31,575 DEBUG [member: 'jenkins-hbase4.apache.org,41881,1676181809304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 06:03:31,576 DEBUG [member: 'jenkins-hbase4.apache.org,41881,1676181809304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41881-0x100472092180001, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 06:03:31,576 DEBUG [member: 'jenkins-hbase4.apache.org,41881,1676181809304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 06:03:31,577 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:31,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:31,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:31,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 06:03:31,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:31,578 DEBUG [member: 'jenkins-hbase4.apache.org,36993,1676181809334' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 06:03:31,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:31,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-12 06:03:31,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41881,1676181809304 2023-02-12 06:03:31,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:31,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:31,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36993,1676181809334' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-12 06:03:31,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50b21edd[Count = 0] remaining members to acquire global barrier 2023-02-12 06:03:31,581 DEBUG [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-12 06:03:31,581 DEBUG [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 06:03:31,581 DEBUG [member: 'jenkins-hbase4.apache.org,36993,1676181809334' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36993-0x100472092180002, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 06:03:31,581 DEBUG [member: 'jenkins-hbase4.apache.org,36993,1676181809334' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 06:03:31,588 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): regionserver:36993-0x100472092180002, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 06:03:31,588 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): regionserver:41881-0x100472092180001, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 06:03:31,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 06:03:31,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 06:03:31,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 06:03:31,588 DEBUG [member: 'jenkins-hbase4.apache.org,36993,1676181809334' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-12 06:03:31,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 06:03:31,588 DEBUG [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:31,588 DEBUG [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 06:03:31,588 DEBUG [member: 'jenkins-hbase4.apache.org,41881,1676181809304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-12 06:03:31,589 DEBUG [member: 'jenkins-hbase4.apache.org,41881,1676181809304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-12 06:03:31,589 DEBUG [member: 'jenkins-hbase4.apache.org,41881,1676181809304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,41881,1676181809304' in zk 2023-02-12 06:03:31,591 DEBUG [member: 'jenkins-hbase4.apache.org,41881,1676181809304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-12 06:03:31,591 DEBUG [member: 'jenkins-hbase4.apache.org,41881,1676181809304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:03:31,591 DEBUG [member: 'jenkins-hbase4.apache.org,41881,1676181809304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-12 06:03:31,592 DEBUG [member: 'jenkins-hbase4.apache.org,36993,1676181809334' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-12 06:03:31,592 DEBUG [member: 'jenkins-hbase4.apache.org,36993,1676181809334' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 06:03:31,592 DEBUG [rs(jenkins-hbase4.apache.org,36993,1676181809334)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497. 2023-02-12 06:03:31,592 DEBUG [rs(jenkins-hbase4.apache.org,36993,1676181809334)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497. started... 2023-02-12 06:03:31,592 INFO [rs(jenkins-hbase4.apache.org,36993,1676181809334)-snapshot-pool-0] regionserver.HRegion(2744): Flushing e86836a77166f5b0251a695ecae49497 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-12 06:03:31,644 INFO [rs(jenkins-hbase4.apache.org,36993,1676181809334)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/.tmp/f1/73209e73692344958c2b5ad6d4c5089a 2023-02-12 06:03:31,699 INFO [rs(jenkins-hbase4.apache.org,36993,1676181809334)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/.tmp/f2/a7f5001918ff443483ac16a90df15ee6 2023-02-12 06:03:31,704 DEBUG [rs(jenkins-hbase4.apache.org,36993,1676181809334)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/.tmp/f1/73209e73692344958c2b5ad6d4c5089a as hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/f1/73209e73692344958c2b5ad6d4c5089a 2023-02-12 06:03:31,708 INFO [rs(jenkins-hbase4.apache.org,36993,1676181809334)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/f1/73209e73692344958c2b5ad6d4c5089a, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-12 06:03:31,709 DEBUG [rs(jenkins-hbase4.apache.org,36993,1676181809334)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/.tmp/f2/a7f5001918ff443483ac16a90df15ee6 as hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/f2/a7f5001918ff443483ac16a90df15ee6 2023-02-12 06:03:31,713 INFO [rs(jenkins-hbase4.apache.org,36993,1676181809334)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/f2/a7f5001918ff443483ac16a90df15ee6, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-12 06:03:31,714 INFO [rs(jenkins-hbase4.apache.org,36993,1676181809334)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for e86836a77166f5b0251a695ecae49497 in 122ms, sequenceid=5, compaction requested=false 2023-02-12 06:03:31,714 DEBUG [rs(jenkins-hbase4.apache.org,36993,1676181809334)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for e86836a77166f5b0251a695ecae49497: 2023-02-12 06:03:31,714 DEBUG [rs(jenkins-hbase4.apache.org,36993,1676181809334)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-12 06:03:31,714 DEBUG [rs(jenkins-hbase4.apache.org,36993,1676181809334)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 06:03:31,714 DEBUG [rs(jenkins-hbase4.apache.org,36993,1676181809334)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/f1/73209e73692344958c2b5ad6d4c5089a] hfiles 2023-02-12 06:03:31,714 DEBUG [rs(jenkins-hbase4.apache.org,36993,1676181809334)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/f1/73209e73692344958c2b5ad6d4c5089a for snapshot=testWithMapReduceSingleRegion 2023-02-12 06:03:31,714 DEBUG [rs(jenkins-hbase4.apache.org,36993,1676181809334)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/f2/a7f5001918ff443483ac16a90df15ee6] hfiles 2023-02-12 06:03:31,714 DEBUG [rs(jenkins-hbase4.apache.org,36993,1676181809334)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/f2/a7f5001918ff443483ac16a90df15ee6 for snapshot=testWithMapReduceSingleRegion 2023-02-12 06:03:31,728 DEBUG [rs(jenkins-hbase4.apache.org,36993,1676181809334)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497. completed. 2023-02-12 06:03:31,728 DEBUG [rs(jenkins-hbase4.apache.org,36993,1676181809334)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497. 2023-02-12 06:03:31,728 DEBUG [member: 'jenkins-hbase4.apache.org,36993,1676181809334' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-12 06:03:31,728 DEBUG [member: 'jenkins-hbase4.apache.org,36993,1676181809334' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-12 06:03:31,728 DEBUG [member: 'jenkins-hbase4.apache.org,36993,1676181809334' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:31,729 DEBUG [member: 'jenkins-hbase4.apache.org,36993,1676181809334' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-12 06:03:31,729 DEBUG [member: 'jenkins-hbase4.apache.org,36993,1676181809334' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,36993,1676181809334' in zk 2023-02-12 06:03:31,730 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:31,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:31,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:31,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 06:03:31,730 DEBUG [member: 'jenkins-hbase4.apache.org,36993,1676181809334' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-12 06:03:31,731 DEBUG [member: 'jenkins-hbase4.apache.org,36993,1676181809334' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:03:31,731 DEBUG [member: 'jenkins-hbase4.apache.org,36993,1676181809334' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-12 06:03:31,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:31,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:31,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-12 06:03:31,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41881,1676181809304 2023-02-12 06:03:31,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:31,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:31,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-12 06:03:31,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41881,1676181809304 2023-02-12 06:03:31,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:31,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,36993,1676181809334': 2023-02-12 06:03:31,734 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36993,1676181809334' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-12 06:03:31,734 INFO [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-12 06:03:31,734 DEBUG [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 06:03:31,734 DEBUG [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 06:03:31,734 DEBUG [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-12 06:03:31,734 INFO [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-12 06:03:31,736 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): regionserver:41881-0x100472092180001, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 06:03:31,736 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): regionserver:36993-0x100472092180002, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 06:03:31,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 06:03:31,736 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): regionserver:41881-0x100472092180001, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 06:03:31,736 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 06:03:31,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 06:03:31,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 06:03:31,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:31,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 06:03:31,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 06:03:31,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 06:03:31,736 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): regionserver:36993-0x100472092180002, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 06:03:31,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 06:03:31,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:03:31,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:31,737 DEBUG [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41881,1676181809304 2023-02-12 06:03:31,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 06:03:31,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:03:31,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 06:03:31,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 06:03:31,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-12 06:03:31,737 DEBUG [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:31,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:31,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-12 06:03:31,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41881,1676181809304 2023-02-12 06:03:31,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:31,739 DEBUG [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41881,1676181809304 2023-02-12 06:03:31,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:31,739 DEBUG [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:31,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-12 06:03:31,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41881,1676181809304 2023-02-12 06:03:31,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:31,746 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:31,746 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): regionserver:41881-0x100472092180001, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 06:03:31,746 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): regionserver:36993-0x100472092180002, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 06:03:31,746 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-12 06:03:31,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 06:03:31,746 DEBUG [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:03:31,746 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): regionserver:36993-0x100472092180002, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 06:03:31,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 06:03:31,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:03:31,746 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): regionserver:41881-0x100472092180001, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 06:03:31,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 06:03:31,746 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-12 06:03:31,746 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41881,1676181809304 2023-02-12 06:03:31,746 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-12 06:03:31,746 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-12 06:03:31,747 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:31,747 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 06:03:31,747 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,41881,1676181809304 2023-02-12 06:03:31,747 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-12 06:03:31,747 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-12 06:03:31,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 06:03:31,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:03:31,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 06:03:31,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 06:03:31,747 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-12 06:03:31,747 DEBUG [Listener at localhost/37311] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 06:03:31,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 06:03:31,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-12 06:03:31,749 DEBUG [Listener at localhost/37311] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-12 06:03:31,766 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-12 06:03:31,785 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-12 06:03:31,785 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-12 06:03:31,785 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-12 06:03:31,785 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676181811427Consolidate snapshot: testWithMapReduceSingleRegion at 1676181811746 (+319 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1676181811747 (+1 ms)Writing data manifest for testWithMapReduceSingleRegion at 1676181811749 (+2 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1676181811759 (+10 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1676181811785 (+26 ms) 2023-02-12 06:03:31,785 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-12 06:03:31,786 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 353 msec 2023-02-12 06:03:32,049 DEBUG [Listener at localhost/37311] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 06:03:32,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-12 06:03:32,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-12 06:03:32,051 INFO [Listener at localhost/37311] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-12 06:03:32,055 INFO [Listener at localhost/37311] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-12 06:03:32,069 INFO [Listener at localhost/37311] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-12 06:03:32,124 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36993] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497. 2023-02-12 06:03:32,255 INFO [Listener at localhost/37311] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-12 06:03:32,261 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-12 06:03:32,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-12 06:03:32,263 INFO [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-12 06:03:32,263 DEBUG [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 06:03:32,263 DEBUG [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-12 06:03:32,263 DEBUG [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-12 06:03:32,264 DEBUG [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:03:32,264 DEBUG [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 06:03:32,265 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): regionserver:41881-0x100472092180001, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 06:03:32,265 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): regionserver:36993-0x100472092180002, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 06:03:32,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 06:03:32,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:03:32,265 DEBUG [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:32,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 06:03:32,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:03:32,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 06:03:32,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 06:03:32,268 DEBUG [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:32,268 DEBUG [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 06:03:32,268 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41881-0x100472092180001, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:03:32,269 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36993-0x100472092180002, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:03:32,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 06:03:32,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 06:03:32,269 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-12 06:03:32,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 06:03:32,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 06:03:32,269 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-12 06:03:32,269 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-12 06:03:32,272 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-12 06:03:32,272 DEBUG [member: 'jenkins-hbase4.apache.org,41881,1676181809304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-12 06:03:32,272 DEBUG [member: 'jenkins-hbase4.apache.org,41881,1676181809304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 06:03:32,272 DEBUG [member: 'jenkins-hbase4.apache.org,41881,1676181809304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-12 06:03:32,272 DEBUG [member: 'jenkins-hbase4.apache.org,41881,1676181809304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-12 06:03:32,273 DEBUG [member: 'jenkins-hbase4.apache.org,41881,1676181809304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41881,1676181809304' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-12 06:03:32,274 DEBUG [member: 'jenkins-hbase4.apache.org,41881,1676181809304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 06:03:32,274 DEBUG [member: 'jenkins-hbase4.apache.org,41881,1676181809304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41881-0x100472092180001, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 06:03:32,274 DEBUG [member: 'jenkins-hbase4.apache.org,41881,1676181809304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 06:03:32,276 DEBUG [member: 'jenkins-hbase4.apache.org,36993,1676181809334' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-12 06:03:32,276 DEBUG [member: 'jenkins-hbase4.apache.org,36993,1676181809334' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 06:03:32,276 DEBUG [member: 'jenkins-hbase4.apache.org,36993,1676181809334' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-12 06:03:32,280 DEBUG [member: 'jenkins-hbase4.apache.org,36993,1676181809334' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 06:03:32,280 DEBUG [member: 'jenkins-hbase4.apache.org,36993,1676181809334' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 06:03:32,280 DEBUG [rs(jenkins-hbase4.apache.org,36993,1676181809334)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497. 2023-02-12 06:03:32,280 DEBUG [rs(jenkins-hbase4.apache.org,36993,1676181809334)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497. started... 2023-02-12 06:03:32,280 INFO [rs(jenkins-hbase4.apache.org,36993,1676181809334)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e86836a77166f5b0251a695ecae49497 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-12 06:03:32,311 INFO [rs(jenkins-hbase4.apache.org,36993,1676181809334)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/.tmp/f1/b55e5fd2bc414bbaa63cae21dba33ea1 2023-02-12 06:03:32,364 INFO [rs(jenkins-hbase4.apache.org,36993,1676181809334)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/.tmp/f2/57e65182ad3a4c54aa8118883abf9896 2023-02-12 06:03:32,369 DEBUG [rs(jenkins-hbase4.apache.org,36993,1676181809334)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/.tmp/f1/b55e5fd2bc414bbaa63cae21dba33ea1 as hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/f1/b55e5fd2bc414bbaa63cae21dba33ea1 2023-02-12 06:03:32,373 INFO [rs(jenkins-hbase4.apache.org,36993,1676181809334)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/f1/b55e5fd2bc414bbaa63cae21dba33ea1, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-12 06:03:32,374 DEBUG [rs(jenkins-hbase4.apache.org,36993,1676181809334)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/.tmp/f2/57e65182ad3a4c54aa8118883abf9896 as hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/f2/57e65182ad3a4c54aa8118883abf9896 2023-02-12 06:03:32,378 INFO [rs(jenkins-hbase4.apache.org,36993,1676181809334)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/f2/57e65182ad3a4c54aa8118883abf9896, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-12 06:03:32,379 INFO [rs(jenkins-hbase4.apache.org,36993,1676181809334)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for e86836a77166f5b0251a695ecae49497 in 99ms, sequenceid=9, compaction requested=false 2023-02-12 06:03:32,379 DEBUG [rs(jenkins-hbase4.apache.org,36993,1676181809334)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e86836a77166f5b0251a695ecae49497: 2023-02-12 06:03:32,379 DEBUG [rs(jenkins-hbase4.apache.org,36993,1676181809334)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497. 2023-02-12 06:03:32,379 DEBUG [member: 'jenkins-hbase4.apache.org,36993,1676181809334' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 06:03:32,379 DEBUG [member: 'jenkins-hbase4.apache.org,36993,1676181809334' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 06:03:32,379 DEBUG [member: 'jenkins-hbase4.apache.org,36993,1676181809334' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:32,379 DEBUG [member: 'jenkins-hbase4.apache.org,36993,1676181809334' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-12 06:03:32,379 DEBUG [member: 'jenkins-hbase4.apache.org,36993,1676181809334' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36993,1676181809334' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-12 06:03:32,388 DEBUG [member: 'jenkins-hbase4.apache.org,36993,1676181809334' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 06:03:32,388 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:32,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:32,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:32,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 06:03:32,388 DEBUG [member: 'jenkins-hbase4.apache.org,36993,1676181809334' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36993-0x100472092180002, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 06:03:32,388 DEBUG [member: 'jenkins-hbase4.apache.org,36993,1676181809334' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 06:03:32,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:32,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:32,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 06:03:32,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41881,1676181809304 2023-02-12 06:03:32,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:32,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:32,391 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36993,1676181809334' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-12 06:03:32,391 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@548d9013[Count = 0] remaining members to acquire global barrier 2023-02-12 06:03:32,391 DEBUG [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-12 06:03:32,391 DEBUG [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 06:03:32,393 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): regionserver:36993-0x100472092180002, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 06:03:32,393 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): regionserver:41881-0x100472092180001, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 06:03:32,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 06:03:32,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 06:03:32,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 06:03:32,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 06:03:32,393 DEBUG [member: 'jenkins-hbase4.apache.org,36993,1676181809334' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-12 06:03:32,393 DEBUG [member: 'jenkins-hbase4.apache.org,36993,1676181809334' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-12 06:03:32,393 DEBUG [member: 'jenkins-hbase4.apache.org,36993,1676181809334' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,36993,1676181809334' in zk 2023-02-12 06:03:32,393 DEBUG [member: 'jenkins-hbase4.apache.org,41881,1676181809304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-12 06:03:32,393 DEBUG [member: 'jenkins-hbase4.apache.org,41881,1676181809304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-12 06:03:32,393 DEBUG [member: 'jenkins-hbase4.apache.org,41881,1676181809304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,41881,1676181809304' in zk 2023-02-12 06:03:32,393 DEBUG [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:32,393 DEBUG [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 06:03:32,395 DEBUG [member: 'jenkins-hbase4.apache.org,36993,1676181809334' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-12 06:03:32,395 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:32,395 DEBUG [member: 'jenkins-hbase4.apache.org,36993,1676181809334' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:03:32,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:32,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:32,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 06:03:32,395 DEBUG [member: 'jenkins-hbase4.apache.org,36993,1676181809334' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-12 06:03:32,395 DEBUG [member: 'jenkins-hbase4.apache.org,41881,1676181809304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-12 06:03:32,395 DEBUG [member: 'jenkins-hbase4.apache.org,41881,1676181809304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:03:32,396 DEBUG [member: 'jenkins-hbase4.apache.org,41881,1676181809304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-12 06:03:32,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:32,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:32,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 06:03:32,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41881,1676181809304 2023-02-12 06:03:32,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:32,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:32,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 06:03:32,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41881,1676181809304 2023-02-12 06:03:32,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:32,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,36993,1676181809334': 2023-02-12 06:03:32,399 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36993,1676181809334' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-12 06:03:32,399 INFO [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-12 06:03:32,399 DEBUG [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 06:03:32,399 DEBUG [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 06:03:32,399 DEBUG [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-12 06:03:32,399 INFO [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 06:03:32,402 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:03:32,402 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): regionserver:36993-0x100472092180002, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:03:32,402 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): regionserver:36993-0x100472092180002, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 06:03:32,402 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): regionserver:41881-0x100472092180001, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:03:32,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:03:32,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 06:03:32,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 06:03:32,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:03:32,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:03:32,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 06:03:32,402 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): regionserver:41881-0x100472092180001, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 06:03:32,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:03:32,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:03:32,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 06:03:32,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:03:32,403 DEBUG [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41881,1676181809304 2023-02-12 06:03:32,404 DEBUG [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:32,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 06:03:32,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:03:32,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 06:03:32,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:03:32,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:03:32,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 06:03:32,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 06:03:32,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41881,1676181809304 2023-02-12 06:03:32,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:32,406 DEBUG [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41881,1676181809304 2023-02-12 06:03:32,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 06:03:32,407 DEBUG [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:32,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-12 06:03:32,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41881,1676181809304 2023-02-12 06:03:32,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:32,410 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:32,410 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 06:03:32,410 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): regionserver:41881-0x100472092180001, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 06:03:32,410 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41881,1676181809304 2023-02-12 06:03:32,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 06:03:32,410 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-12 06:03:32,410 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): regionserver:41881-0x100472092180001, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 06:03:32,410 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:32,410 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): regionserver:36993-0x100472092180002, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 06:03:32,410 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-12 06:03:32,410 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 06:03:32,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:03:32,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 06:03:32,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 06:03:32,410 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): regionserver:36993-0x100472092180002, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 06:03:32,410 DEBUG [(jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 06:03:32,410 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 06:03:32,411 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41881,1676181809304 2023-02-12 06:03:32,411 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-12 06:03:32,411 DEBUG [Listener at localhost/37311] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-12 06:03:32,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 06:03:32,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:03:32,411 DEBUG [Listener at localhost/37311] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 06:03:32,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 06:03:32,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 06:03:32,411 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-12 06:03:32,511 DEBUG [Listener at localhost/37311] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 06:03:32,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 06:03:32,622 DEBUG [Listener at localhost/37311] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e687fc21-5a6e-91dc-b0d3-6ec9f9eb174b/hadoop-4837385349205662740.jar 2023-02-12 06:03:32,631 INFO [Listener at localhost/37311] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676181811395 type: FLUSH version: 2 ttl: 0 2023-02-12 06:03:32,632 DEBUG [Listener at localhost/37311] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:42309/user/jenkins/test-data/e69ac9de-0161-9e0c-e60d-0ea4942db3dd/testWithMapReduceSingleRegion/c0d859bc-39db-457a-b008-347339ed1a62/data/default/testWithMapReduce 2023-02-12 06:03:32,632 INFO [Listener at localhost/37311] snapshot.RestoreSnapshotHelper(239): region to add: e86836a77166f5b0251a695ecae49497 2023-02-12 06:03:32,632 INFO [Listener at localhost/37311] snapshot.RestoreSnapshotHelper(585): clone region=e86836a77166f5b0251a695ecae49497 as e86836a77166f5b0251a695ecae49497 in snapshot testWithMapReduceSingleRegion 2023-02-12 06:03:32,661 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => e86836a77166f5b0251a695ecae49497, NAME => 'testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42309/user/jenkins/test-data/e69ac9de-0161-9e0c-e60d-0ea4942db3dd/testWithMapReduceSingleRegion/c0d859bc-39db-457a-b008-347339ed1a62 2023-02-12 06:03:32,669 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:32,669 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 73209e73692344958c2b5ad6d4c5089a from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-12 06:03:32,676 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a7f5001918ff443483ac16a90df15ee6 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-12 06:03:32,678 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing e86836a77166f5b0251a695ecae49497, disabling compactions & flushes 2023-02-12 06:03:32,679 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497. 2023-02-12 06:03:32,679 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497. 2023-02-12 06:03:32,679 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497. after waiting 0 ms 2023-02-12 06:03:32,679 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497. 2023-02-12 06:03:32,679 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497. 2023-02-12 06:03:32,679 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for e86836a77166f5b0251a695ecae49497: Waiting for close lock at 1676181812678Disabling compacts and flushes for region at 1676181812678Disabling writes for close at 1676181812679 (+1 ms)Writing region close event to WAL at 1676181812679Closed at 1676181812679 2023-02-12 06:03:32,679 INFO [Listener at localhost/37311] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676181811395 type: FLUSH version: 2 ttl: 0 2023-02-12 06:03:32,679 DEBUG [Listener at localhost/37311] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:42309/user/jenkins/test-data/e69ac9de-0161-9e0c-e60d-0ea4942db3dd/testWithMapReduceSingleRegion/c0d859bc-39db-457a-b008-347339ed1a62 2023-02-12 06:03:32,679 DEBUG [Listener at localhost/37311] util.CommonFSUtils(682): File system contents for path hdfs://localhost:42309/user/jenkins/test-data/e69ac9de-0161-9e0c-e60d-0ea4942db3dd/testWithMapReduceSingleRegion/c0d859bc-39db-457a-b008-347339ed1a62 2023-02-12 06:03:32,680 DEBUG [Listener at localhost/37311] util.CommonFSUtils(699): |-data/ 2023-02-12 06:03:32,680 DEBUG [Listener at localhost/37311] util.CommonFSUtils(699): |----default/ 2023-02-12 06:03:32,681 DEBUG [Listener at localhost/37311] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-12 06:03:32,681 DEBUG [Listener at localhost/37311] util.CommonFSUtils(699): |----------e86836a77166f5b0251a695ecae49497/ 2023-02-12 06:03:32,682 DEBUG [Listener at localhost/37311] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-12 06:03:32,682 DEBUG [Listener at localhost/37311] util.CommonFSUtils(699): |-------------f1/ 2023-02-12 06:03:32,682 DEBUG [Listener at localhost/37311] util.CommonFSUtils(702): |----------------testWithMapReduce=e86836a77166f5b0251a695ecae49497-73209e73692344958c2b5ad6d4c5089a 2023-02-12 06:03:32,682 DEBUG [Listener at localhost/37311] util.CommonFSUtils(699): |-------------f2/ 2023-02-12 06:03:32,683 DEBUG [Listener at localhost/37311] util.CommonFSUtils(702): |----------------testWithMapReduce=e86836a77166f5b0251a695ecae49497-a7f5001918ff443483ac16a90df15ee6 2023-02-12 06:03:32,683 DEBUG [Listener at localhost/37311] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-12 06:03:32,684 DEBUG [Listener at localhost/37311] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-12 06:03:32,684 DEBUG [Listener at localhost/37311] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-12 06:03:32,685 DEBUG [Listener at localhost/37311] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-12 06:03:33,692 DEBUG [Listener at localhost/37311] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e687fc21-5a6e-91dc-b0d3-6ec9f9eb174b/hadoop-6219303263026395704.jar 2023-02-12 06:03:33,693 DEBUG [Listener at localhost/37311] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-12 06:03:33,694 DEBUG [Listener at localhost/37311] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-12 06:03:33,774 DEBUG [Listener at localhost/37311] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e687fc21-5a6e-91dc-b0d3-6ec9f9eb174b/hadoop-4290306374918995262.jar 2023-02-12 06:03:33,775 DEBUG [Listener at localhost/37311] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-12 06:03:33,775 DEBUG [Listener at localhost/37311] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-12 06:03:33,776 DEBUG [Listener at localhost/37311] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-12 06:03:33,776 DEBUG [Listener at localhost/37311] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-12 06:03:33,776 DEBUG [Listener at localhost/37311] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-12 06:03:33,777 DEBUG [Listener at localhost/37311] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-12 06:03:33,777 DEBUG [Listener at localhost/37311] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-12 06:03:33,777 DEBUG [Listener at localhost/37311] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-12 06:03:33,778 DEBUG [Listener at localhost/37311] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-12 06:03:33,778 DEBUG [Listener at localhost/37311] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-12 06:03:33,778 DEBUG [Listener at localhost/37311] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-12 06:03:33,779 DEBUG [Listener at localhost/37311] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-12 06:03:33,779 DEBUG [Listener at localhost/37311] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-12 06:03:33,780 DEBUG [Listener at localhost/37311] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-12 06:03:33,780 DEBUG [Listener at localhost/37311] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-12 06:03:33,780 DEBUG [Listener at localhost/37311] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-12 06:03:33,781 DEBUG [Listener at localhost/37311] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-12 06:03:33,781 DEBUG [Listener at localhost/37311] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 06:03:33,782 DEBUG [Listener at localhost/37311] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 06:03:33,782 DEBUG [Listener at localhost/37311] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-12 06:03:33,783 DEBUG [Listener at localhost/37311] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-12 06:03:33,853 DEBUG [Listener at localhost/37311] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e687fc21-5a6e-91dc-b0d3-6ec9f9eb174b/hadoop-2200308752068991958.jar 2023-02-12 06:03:33,854 DEBUG [Listener at localhost/37311] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-12 06:03:33,860 WARN [Listener at localhost/37311] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-12 06:03:33,866 WARN [Listener at localhost/37311] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-12 06:03:33,872 INFO [Listener at localhost/37311] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-12 06:03:33,967 WARN [Listener at localhost/37311] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e687fc21-5a6e-91dc-b0d3-6ec9f9eb174b/mapreduce.cluster.local.dir/1676181813920/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-12 06:03:33,967 WARN [Listener at localhost/37311] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e687fc21-5a6e-91dc-b0d3-6ec9f9eb174b/mapreduce.cluster.local.dir/1676181813920/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-12 06:03:34,014 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 06:03:34,015 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-12 06:03:34,015 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 06:03:34,019 INFO [StoreOpener-e86836a77166f5b0251a695ecae49497-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e86836a77166f5b0251a695ecae49497 2023-02-12 06:03:34,020 DEBUG [StoreOpener-e86836a77166f5b0251a695ecae49497-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42309/user/jenkins/test-data/e69ac9de-0161-9e0c-e60d-0ea4942db3dd/testWithMapReduceSingleRegion/c0d859bc-39db-457a-b008-347339ed1a62/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/f1 2023-02-12 06:03:34,020 INFO [StoreOpener-e86836a77166f5b0251a695ecae49497-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e86836a77166f5b0251a695ecae49497 columnFamilyName f1 2023-02-12 06:03:34,025 DEBUG [StoreOpener-e86836a77166f5b0251a695ecae49497-1] regionserver.HStore(539): loaded hdfs://localhost:42309/user/jenkins/test-data/e69ac9de-0161-9e0c-e60d-0ea4942db3dd/testWithMapReduceSingleRegion/c0d859bc-39db-457a-b008-347339ed1a62/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/f1/testWithMapReduce=e86836a77166f5b0251a695ecae49497-73209e73692344958c2b5ad6d4c5089a 2023-02-12 06:03:34,025 INFO [StoreOpener-e86836a77166f5b0251a695ecae49497-1] regionserver.HStore(310): Store=e86836a77166f5b0251a695ecae49497/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:34,025 INFO [StoreOpener-e86836a77166f5b0251a695ecae49497-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e86836a77166f5b0251a695ecae49497 2023-02-12 06:03:34,026 DEBUG [StoreOpener-e86836a77166f5b0251a695ecae49497-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42309/user/jenkins/test-data/e69ac9de-0161-9e0c-e60d-0ea4942db3dd/testWithMapReduceSingleRegion/c0d859bc-39db-457a-b008-347339ed1a62/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/f2 2023-02-12 06:03:34,026 INFO [StoreOpener-e86836a77166f5b0251a695ecae49497-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e86836a77166f5b0251a695ecae49497 columnFamilyName f2 2023-02-12 06:03:34,030 DEBUG [StoreOpener-e86836a77166f5b0251a695ecae49497-1] regionserver.HStore(539): loaded hdfs://localhost:42309/user/jenkins/test-data/e69ac9de-0161-9e0c-e60d-0ea4942db3dd/testWithMapReduceSingleRegion/c0d859bc-39db-457a-b008-347339ed1a62/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/f2/testWithMapReduce=e86836a77166f5b0251a695ecae49497-a7f5001918ff443483ac16a90df15ee6 2023-02-12 06:03:34,030 INFO [StoreOpener-e86836a77166f5b0251a695ecae49497-1] regionserver.HStore(310): Store=e86836a77166f5b0251a695ecae49497/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 06:03:34,031 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 06:03:34,031 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e86836a77166f5b0251a695ecae49497; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66748653, jitterRate=-0.005367562174797058}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 06:03:34,031 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e86836a77166f5b0251a695ecae49497: Writing region info on filesystem at 1676181814015Initializing all the Stores at 1676181814016 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181814016Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676181814018 (+2 ms)Region opened successfully at 1676181814031 (+13 ms) 2023-02-12 06:03:34,114 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e86836a77166f5b0251a695ecae49497, disabling compactions & flushes 2023-02-12 06:03:34,114 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497. 2023-02-12 06:03:34,114 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497. 2023-02-12 06:03:34,114 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497. after waiting 0 ms 2023-02-12 06:03:34,114 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497. 2023-02-12 06:03:34,115 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497. 2023-02-12 06:03:34,115 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e86836a77166f5b0251a695ecae49497: Waiting for close lock at 1676181814114Disabling compacts and flushes for region at 1676181814114Disabling writes for close at 1676181814114Writing region close event to WAL at 1676181814115 (+1 ms)Closed at 1676181814115 2023-02-12 06:03:35,020 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceSingleRegion" 2023-02-12 06:03:35,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-12 06:03:35,023 INFO [Listener at localhost/37311] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-12 06:03:35,024 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-12 06:03:35,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-12 06:03:35,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 06:03:35,029 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676181815029"}]},"ts":"1676181815029"} 2023-02-12 06:03:35,030 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-12 06:03:35,031 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-12 06:03:35,032 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e86836a77166f5b0251a695ecae49497, UNASSIGN}] 2023-02-12 06:03:35,032 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e86836a77166f5b0251a695ecae49497, UNASSIGN 2023-02-12 06:03:35,033 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=e86836a77166f5b0251a695ecae49497, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:35,033 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676181815033"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676181815033"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676181815033"}]},"ts":"1676181815033"} 2023-02-12 06:03:35,034 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure e86836a77166f5b0251a695ecae49497, server=jenkins-hbase4.apache.org,36993,1676181809334}] 2023-02-12 06:03:35,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 06:03:35,186 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e86836a77166f5b0251a695ecae49497 2023-02-12 06:03:35,186 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e86836a77166f5b0251a695ecae49497, disabling compactions & flushes 2023-02-12 06:03:35,186 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497. 2023-02-12 06:03:35,186 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497. 2023-02-12 06:03:35,187 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497. after waiting 0 ms 2023-02-12 06:03:35,187 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497. 2023-02-12 06:03:35,191 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-12 06:03:35,192 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497. 2023-02-12 06:03:35,192 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e86836a77166f5b0251a695ecae49497: Waiting for close lock at 1676181815186Running coprocessor pre-close hooks at 1676181815186Disabling compacts and flushes for region at 1676181815186Disabling writes for close at 1676181815187 (+1 ms)Writing region close event to WAL at 1676181815187Running coprocessor post-close hooks at 1676181815192 (+5 ms)Closed at 1676181815192 2023-02-12 06:03:35,193 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e86836a77166f5b0251a695ecae49497 2023-02-12 06:03:35,193 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=e86836a77166f5b0251a695ecae49497, regionState=CLOSED 2023-02-12 06:03:35,194 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676181815193"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676181815193"}]},"ts":"1676181815193"} 2023-02-12 06:03:35,196 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-12 06:03:35,196 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure e86836a77166f5b0251a695ecae49497, server=jenkins-hbase4.apache.org,36993,1676181809334 in 161 msec 2023-02-12 06:03:35,197 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-12 06:03:35,197 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e86836a77166f5b0251a695ecae49497, UNASSIGN in 164 msec 2023-02-12 06:03:35,198 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676181815198"}]},"ts":"1676181815198"} 2023-02-12 06:03:35,199 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-12 06:03:35,201 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-12 06:03:35,203 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 178 msec 2023-02-12 06:03:35,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-12 06:03:35,330 INFO [Listener at localhost/37311] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-12 06:03:35,331 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-12 06:03:35,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-12 06:03:35,333 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 06:03:35,334 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 06:03:35,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-12 06:03:35,336 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/.tmp/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497 2023-02-12 06:03:35,338 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/.tmp/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/f1, FileablePath, hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/.tmp/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/f2, FileablePath, hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/.tmp/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/recovered.edits] 2023-02-12 06:03:35,341 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/.tmp/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/f1/73209e73692344958c2b5ad6d4c5089a to hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/archive/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/f1/73209e73692344958c2b5ad6d4c5089a 2023-02-12 06:03:35,342 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/.tmp/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/f1/b55e5fd2bc414bbaa63cae21dba33ea1 to hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/archive/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/f1/b55e5fd2bc414bbaa63cae21dba33ea1 2023-02-12 06:03:35,344 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/.tmp/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/f2/57e65182ad3a4c54aa8118883abf9896 to hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/archive/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/f2/57e65182ad3a4c54aa8118883abf9896 2023-02-12 06:03:35,345 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/.tmp/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/f2/a7f5001918ff443483ac16a90df15ee6 to hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/archive/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/f2/a7f5001918ff443483ac16a90df15ee6 2023-02-12 06:03:35,346 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/.tmp/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/recovered.edits/12.seqid to hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/archive/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497/recovered.edits/12.seqid 2023-02-12 06:03:35,347 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/.tmp/data/default/testWithMapReduce/e86836a77166f5b0251a695ecae49497 2023-02-12 06:03:35,347 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-12 06:03:35,349 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 06:03:35,350 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-12 06:03:35,351 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-12 06:03:35,352 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 06:03:35,352 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-12 06:03:35,352 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676181815352"}]},"ts":"9223372036854775807"} 2023-02-12 06:03:35,353 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-12 06:03:35,354 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e86836a77166f5b0251a695ecae49497, NAME => 'testWithMapReduce,,1676181810588.e86836a77166f5b0251a695ecae49497.', STARTKEY => '', ENDKEY => ''}] 2023-02-12 06:03:35,354 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-12 06:03:35,354 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676181815354"}]},"ts":"9223372036854775807"} 2023-02-12 06:03:35,355 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-12 06:03:35,358 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-12 06:03:35,358 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 27 msec 2023-02-12 06:03:35,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41405] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-12 06:03:35,435 INFO [Listener at localhost/37311] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-12 06:03:35,436 INFO [Listener at localhost/37311] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-12 06:03:35,436 INFO [Listener at localhost/37311] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 06:03:35,436 DEBUG [Listener at localhost/37311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54056a68 to 127.0.0.1:50136 2023-02-12 06:03:35,436 DEBUG [Listener at localhost/37311] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:35,436 DEBUG [Listener at localhost/37311] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-12 06:03:35,436 DEBUG [Listener at localhost/37311] util.JVMClusterUtil(257): Found active master hash=1160892846, stopped=false 2023-02-12 06:03:35,436 INFO [Listener at localhost/37311] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,41405,1676181809253 2023-02-12 06:03:35,437 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 06:03:35,437 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): regionserver:41881-0x100472092180001, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 06:03:35,438 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:35,437 INFO [Listener at localhost/37311] procedure2.ProcedureExecutor(629): Stopping 2023-02-12 06:03:35,437 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): regionserver:36993-0x100472092180002, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 06:03:35,438 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41881-0x100472092180001, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:03:35,439 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:03:35,439 DEBUG [Listener at localhost/37311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2f719db9 to 127.0.0.1:50136 2023-02-12 06:03:35,439 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36993-0x100472092180002, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 06:03:35,439 DEBUG [Listener at localhost/37311] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:35,440 INFO [Listener at localhost/37311] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41881,1676181809304' ***** 2023-02-12 06:03:35,440 INFO [Listener at localhost/37311] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 06:03:35,440 INFO [Listener at localhost/37311] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36993,1676181809334' ***** 2023-02-12 06:03:35,440 INFO [Listener at localhost/37311] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 06:03:35,440 INFO [RS:0;jenkins-hbase4:41881] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 06:03:35,440 INFO [RS:1;jenkins-hbase4:36993] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 06:03:35,440 INFO [RS:0;jenkins-hbase4:41881] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 06:03:35,440 INFO [RS:1;jenkins-hbase4:36993] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 06:03:35,440 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 06:03:35,440 INFO [RS:1;jenkins-hbase4:36993] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 06:03:35,440 INFO [RS:0;jenkins-hbase4:41881] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 06:03:35,440 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 06:03:35,441 INFO [RS:0;jenkins-hbase4:41881] regionserver.HRegionServer(3304): Received CLOSE for e9813399069108a418462390e67932c4 2023-02-12 06:03:35,441 INFO [RS:1;jenkins-hbase4:36993] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:35,442 DEBUG [RS:1;jenkins-hbase4:36993] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x524b5324 to 127.0.0.1:50136 2023-02-12 06:03:35,442 DEBUG [RS:1;jenkins-hbase4:36993] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:35,442 INFO [RS:0;jenkins-hbase4:41881] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41881,1676181809304 2023-02-12 06:03:35,442 INFO [RS:1;jenkins-hbase4:36993] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36993,1676181809334; all regions closed. 2023-02-12 06:03:35,442 DEBUG [RS:0;jenkins-hbase4:41881] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a1debe1 to 127.0.0.1:50136 2023-02-12 06:03:35,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e9813399069108a418462390e67932c4, disabling compactions & flushes 2023-02-12 06:03:35,442 DEBUG [RS:0;jenkins-hbase4:41881] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:35,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676181809902.e9813399069108a418462390e67932c4. 2023-02-12 06:03:35,443 INFO [RS:0;jenkins-hbase4:41881] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 06:03:35,443 INFO [RS:0;jenkins-hbase4:41881] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 06:03:35,443 INFO [RS:0;jenkins-hbase4:41881] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 06:03:35,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676181809902.e9813399069108a418462390e67932c4. 2023-02-12 06:03:35,443 INFO [RS:0;jenkins-hbase4:41881] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-12 06:03:35,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676181809902.e9813399069108a418462390e67932c4. after waiting 0 ms 2023-02-12 06:03:35,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676181809902.e9813399069108a418462390e67932c4. 2023-02-12 06:03:35,443 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing e9813399069108a418462390e67932c4 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-12 06:03:35,443 INFO [RS:0;jenkins-hbase4:41881] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-12 06:03:35,443 DEBUG [RS:0;jenkins-hbase4:41881] regionserver.HRegionServer(1479): Online Regions={e9813399069108a418462390e67932c4=hbase:namespace,,1676181809902.e9813399069108a418462390e67932c4., 1588230740=hbase:meta,,1.1588230740} 2023-02-12 06:03:35,443 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 06:03:35,443 DEBUG [RS:0;jenkins-hbase4:41881] regionserver.HRegionServer(1505): Waiting on 1588230740, e9813399069108a418462390e67932c4 2023-02-12 06:03:35,443 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 06:03:35,443 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 06:03:35,443 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 06:03:35,443 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 06:03:35,443 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.70 KB heapSize=7.12 KB 2023-02-12 06:03:35,444 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/WALs/jenkins-hbase4.apache.org,36993,1676181809334/jenkins-hbase4.apache.org%2C36993%2C1676181809334.1676181810633 not finished, retry = 0 2023-02-12 06:03:35,446 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 06:03:35,451 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/hbase/meta/1588230740/.tmp/info/cb4a712c29524b66abaf49816c4c6ccd 2023-02-12 06:03:35,451 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/hbase/namespace/e9813399069108a418462390e67932c4/.tmp/info/6e59fab0ab0647d585e45496799c6a67 2023-02-12 06:03:35,455 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cb4a712c29524b66abaf49816c4c6ccd 2023-02-12 06:03:35,456 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/hbase/namespace/e9813399069108a418462390e67932c4/.tmp/info/6e59fab0ab0647d585e45496799c6a67 as hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/hbase/namespace/e9813399069108a418462390e67932c4/info/6e59fab0ab0647d585e45496799c6a67 2023-02-12 06:03:35,459 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/hbase/namespace/e9813399069108a418462390e67932c4/info/6e59fab0ab0647d585e45496799c6a67, entries=2, sequenceid=6, filesize=4.8 K 2023-02-12 06:03:35,460 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for e9813399069108a418462390e67932c4 in 17ms, sequenceid=6, compaction requested=false 2023-02-12 06:03:35,462 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/hbase/meta/1588230740/.tmp/rep_barrier/614d85d08c2a4ae8815ad4cd2873a7da 2023-02-12 06:03:35,463 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/hbase/namespace/e9813399069108a418462390e67932c4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-12 06:03:35,464 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676181809902.e9813399069108a418462390e67932c4. 2023-02-12 06:03:35,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e9813399069108a418462390e67932c4: Waiting for close lock at 1676181815442Running coprocessor pre-close hooks at 1676181815442Disabling compacts and flushes for region at 1676181815442Disabling writes for close at 1676181815443 (+1 ms)Obtaining lock to block concurrent updates at 1676181815443Preparing flush snapshotting stores in e9813399069108a418462390e67932c4 at 1676181815443Finished memstore snapshotting hbase:namespace,,1676181809902.e9813399069108a418462390e67932c4., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676181815443Flushing stores of hbase:namespace,,1676181809902.e9813399069108a418462390e67932c4. at 1676181815444 (+1 ms)Flushing e9813399069108a418462390e67932c4/info: creating writer at 1676181815444Flushing e9813399069108a418462390e67932c4/info: appending metadata at 1676181815446 (+2 ms)Flushing e9813399069108a418462390e67932c4/info: closing flushed file at 1676181815446Flushing e9813399069108a418462390e67932c4/info: reopening flushed file at 1676181815456 (+10 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for e9813399069108a418462390e67932c4 in 17ms, sequenceid=6, compaction requested=false at 1676181815460 (+4 ms)Writing region close event to WAL at 1676181815461 (+1 ms)Running coprocessor post-close hooks at 1676181815463 (+2 ms)Closed at 1676181815464 (+1 ms) 2023-02-12 06:03:35,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676181809902.e9813399069108a418462390e67932c4. 2023-02-12 06:03:35,465 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 614d85d08c2a4ae8815ad4cd2873a7da 2023-02-12 06:03:35,471 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/hbase/meta/1588230740/.tmp/table/a6cdb69f1e994baebd4323aea760c850 2023-02-12 06:03:35,474 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a6cdb69f1e994baebd4323aea760c850 2023-02-12 06:03:35,474 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/hbase/meta/1588230740/.tmp/info/cb4a712c29524b66abaf49816c4c6ccd as hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/hbase/meta/1588230740/info/cb4a712c29524b66abaf49816c4c6ccd 2023-02-12 06:03:35,477 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cb4a712c29524b66abaf49816c4c6ccd 2023-02-12 06:03:35,477 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/hbase/meta/1588230740/info/cb4a712c29524b66abaf49816c4c6ccd, entries=12, sequenceid=21, filesize=6.2 K 2023-02-12 06:03:35,478 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/hbase/meta/1588230740/.tmp/rep_barrier/614d85d08c2a4ae8815ad4cd2873a7da as hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/hbase/meta/1588230740/rep_barrier/614d85d08c2a4ae8815ad4cd2873a7da 2023-02-12 06:03:35,481 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 614d85d08c2a4ae8815ad4cd2873a7da 2023-02-12 06:03:35,481 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/hbase/meta/1588230740/rep_barrier/614d85d08c2a4ae8815ad4cd2873a7da, entries=1, sequenceid=21, filesize=5.0 K 2023-02-12 06:03:35,481 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/hbase/meta/1588230740/.tmp/table/a6cdb69f1e994baebd4323aea760c850 as hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/hbase/meta/1588230740/table/a6cdb69f1e994baebd4323aea760c850 2023-02-12 06:03:35,484 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a6cdb69f1e994baebd4323aea760c850 2023-02-12 06:03:35,484 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/hbase/meta/1588230740/table/a6cdb69f1e994baebd4323aea760c850, entries=4, sequenceid=21, filesize=5.0 K 2023-02-12 06:03:35,485 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 42ms, sequenceid=21, compaction requested=false 2023-02-12 06:03:35,487 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-12 06:03:35,488 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 06:03:35,489 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 06:03:35,489 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676181815443Running coprocessor pre-close hooks at 1676181815443Disabling compacts and flushes for region at 1676181815443Disabling writes for close at 1676181815443Obtaining lock to block concurrent updates at 1676181815443Preparing flush snapshotting stores in 1588230740 at 1676181815443Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=3789, getHeapSize=7240, getOffHeapSize=0, getCellsCount=36 at 1676181815444 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1676181815444Flushing 1588230740/info: creating writer at 1676181815444Flushing 1588230740/info: appending metadata at 1676181815446 (+2 ms)Flushing 1588230740/info: closing flushed file at 1676181815446Flushing 1588230740/rep_barrier: creating writer at 1676181815455 (+9 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676181815457 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676181815457Flushing 1588230740/table: creating writer at 1676181815465 (+8 ms)Flushing 1588230740/table: appending metadata at 1676181815467 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676181815467Flushing 1588230740/info: reopening flushed file at 1676181815475 (+8 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676181815478 (+3 ms)Flushing 1588230740/table: reopening flushed file at 1676181815482 (+4 ms)Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 42ms, sequenceid=21, compaction requested=false at 1676181815485 (+3 ms)Writing region close event to WAL at 1676181815485Running coprocessor post-close hooks at 1676181815488 (+3 ms)Closed at 1676181815489 (+1 ms) 2023-02-12 06:03:35,489 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-12 06:03:35,494 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 06:03:35,546 DEBUG [RS:1;jenkins-hbase4:36993] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/oldWALs 2023-02-12 06:03:35,546 INFO [RS:1;jenkins-hbase4:36993] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36993%2C1676181809334:(num 1676181810633) 2023-02-12 06:03:35,546 DEBUG [RS:1;jenkins-hbase4:36993] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:35,546 INFO [RS:1;jenkins-hbase4:36993] regionserver.LeaseManager(133): Closed leases 2023-02-12 06:03:35,546 INFO [RS:1;jenkins-hbase4:36993] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-12 06:03:35,547 INFO [RS:1;jenkins-hbase4:36993] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 06:03:35,547 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 06:03:35,547 INFO [RS:1;jenkins-hbase4:36993] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 06:03:35,547 INFO [RS:1;jenkins-hbase4:36993] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 06:03:35,548 INFO [RS:1;jenkins-hbase4:36993] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36993 2023-02-12 06:03:35,549 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 06:03:35,549 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): regionserver:41881-0x100472092180001, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:35,549 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): regionserver:36993-0x100472092180002, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36993,1676181809334 2023-02-12 06:03:35,549 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): regionserver:41881-0x100472092180001, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 06:03:35,549 ERROR [Listener at localhost/37311-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@30ac9e09 rejected from java.util.concurrent.ThreadPoolExecutor@34931cc4[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:35,550 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): regionserver:36993-0x100472092180002, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 06:03:35,550 ERROR [Listener at localhost/37311-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@14a29b63 rejected from java.util.concurrent.ThreadPoolExecutor@34931cc4[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:35,550 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36993,1676181809334] 2023-02-12 06:03:35,550 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36993,1676181809334; numProcessing=1 2023-02-12 06:03:35,552 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36993,1676181809334 already deleted, retry=false 2023-02-12 06:03:35,552 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36993,1676181809334 expired; onlineServers=1 2023-02-12 06:03:35,611 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-12 06:03:35,612 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-12 06:03:35,643 INFO [RS:0;jenkins-hbase4:41881] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41881,1676181809304; all regions closed. 2023-02-12 06:03:35,647 DEBUG [RS:0;jenkins-hbase4:41881] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/oldWALs 2023-02-12 06:03:35,647 INFO [RS:0;jenkins-hbase4:41881] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41881%2C1676181809304.meta:.meta(num 1676181809833) 2023-02-12 06:03:35,650 DEBUG [RS:0;jenkins-hbase4:41881] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/oldWALs 2023-02-12 06:03:35,650 INFO [RS:0;jenkins-hbase4:41881] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41881%2C1676181809304:(num 1676181810300) 2023-02-12 06:03:35,650 DEBUG [RS:0;jenkins-hbase4:41881] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:35,650 INFO [RS:0;jenkins-hbase4:41881] regionserver.LeaseManager(133): Closed leases 2023-02-12 06:03:35,651 INFO [RS:0;jenkins-hbase4:41881] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-12 06:03:35,651 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 06:03:35,654 INFO [RS:0;jenkins-hbase4:41881] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41881 2023-02-12 06:03:35,656 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): regionserver:41881-0x100472092180001, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41881,1676181809304 2023-02-12 06:03:35,656 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 06:03:35,656 ERROR [Listener at localhost/37311-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@44788a45 rejected from java.util.concurrent.ThreadPoolExecutor@40471612[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:35,657 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41881,1676181809304] 2023-02-12 06:03:35,657 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41881,1676181809304; numProcessing=2 2023-02-12 06:03:35,658 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41881,1676181809304 already deleted, retry=false 2023-02-12 06:03:35,658 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41881,1676181809304 expired; onlineServers=0 2023-02-12 06:03:35,658 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41405,1676181809253' ***** 2023-02-12 06:03:35,658 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-12 06:03:35,659 DEBUG [M:0;jenkins-hbase4:41405] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@410e5dd0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-12 06:03:35,659 INFO [M:0;jenkins-hbase4:41405] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41405,1676181809253 2023-02-12 06:03:35,659 INFO [M:0;jenkins-hbase4:41405] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41405,1676181809253; all regions closed. 2023-02-12 06:03:35,659 DEBUG [M:0;jenkins-hbase4:41405] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 06:03:35,659 DEBUG [M:0;jenkins-hbase4:41405] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-12 06:03:35,659 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-12 06:03:35,659 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676181809488] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676181809488,5,FailOnTimeoutGroup] 2023-02-12 06:03:35,659 DEBUG [M:0;jenkins-hbase4:41405] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-12 06:03:35,659 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676181809489] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676181809489,5,FailOnTimeoutGroup] 2023-02-12 06:03:35,660 INFO [M:0;jenkins-hbase4:41405] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-12 06:03:35,661 INFO [M:0;jenkins-hbase4:41405] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-12 06:03:35,661 INFO [M:0;jenkins-hbase4:41405] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-12 06:03:35,661 DEBUG [M:0;jenkins-hbase4:41405] master.HMaster(1502): Stopping service threads 2023-02-12 06:03:35,662 INFO [M:0;jenkins-hbase4:41405] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-12 06:03:35,662 ERROR [M:0;jenkins-hbase4:41405] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-12 06:03:35,663 INFO [M:0;jenkins-hbase4:41405] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-12 06:03:35,663 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-12 06:03:35,664 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-12 06:03:35,664 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 06:03:35,664 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 06:03:35,664 DEBUG [M:0;jenkins-hbase4:41405] zookeeper.ZKUtil(398): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-12 06:03:35,664 WARN [M:0;jenkins-hbase4:41405] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-12 06:03:35,664 INFO [M:0;jenkins-hbase4:41405] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-12 06:03:35,665 INFO [M:0;jenkins-hbase4:41405] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-12 06:03:35,665 DEBUG [M:0;jenkins-hbase4:41405] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 06:03:35,665 INFO [M:0;jenkins-hbase4:41405] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:35,665 DEBUG [M:0;jenkins-hbase4:41405] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:35,665 DEBUG [M:0;jenkins-hbase4:41405] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 06:03:35,665 DEBUG [M:0;jenkins-hbase4:41405] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:35,665 INFO [M:0;jenkins-hbase4:41405] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.67 KB heapSize=65.63 KB 2023-02-12 06:03:35,674 INFO [M:0;jenkins-hbase4:41405] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.67 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/5aa97d947eae4fb0b9711b30095d4f80 2023-02-12 06:03:35,677 DEBUG [M:0;jenkins-hbase4:41405] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/5aa97d947eae4fb0b9711b30095d4f80 as hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/5aa97d947eae4fb0b9711b30095d4f80 2023-02-12 06:03:35,681 INFO [M:0;jenkins-hbase4:41405] regionserver.HStore(1080): Added hdfs://localhost:42309/user/jenkins/test-data/7b086c9f-e217-834a-296e-9d81f5324ddc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/5aa97d947eae4fb0b9711b30095d4f80, entries=17, sequenceid=132, filesize=8.6 K 2023-02-12 06:03:35,681 INFO [M:0;jenkins-hbase4:41405] regionserver.HRegion(2947): Finished flush of dataSize ~54.67 KB/55987, heapSize ~65.61 KB/67184, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false 2023-02-12 06:03:35,682 INFO [M:0;jenkins-hbase4:41405] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 06:03:35,682 DEBUG [M:0;jenkins-hbase4:41405] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676181815665Disabling compacts and flushes for region at 1676181815665Disabling writes for close at 1676181815665Obtaining lock to block concurrent updates at 1676181815665Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676181815665Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=55987, getHeapSize=67184, getOffHeapSize=0, getCellsCount=145 at 1676181815665Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676181815666 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676181815666Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676181815668 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676181815668Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676181815678 (+10 ms)Finished flush of dataSize ~54.67 KB/55987, heapSize ~65.61 KB/67184, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=132, compaction requested=false at 1676181815681 (+3 ms)Writing region close event to WAL at 1676181815682 (+1 ms)Closed at 1676181815682 2023-02-12 06:03:35,684 INFO [M:0;jenkins-hbase4:41405] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-12 06:03:35,684 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 06:03:35,684 INFO [M:0;jenkins-hbase4:41405] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41405 2023-02-12 06:03:35,685 DEBUG [M:0;jenkins-hbase4:41405] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,41405,1676181809253 already deleted, retry=false 2023-02-12 06:03:35,819 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-12 06:03:35,938 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:03:35,938 INFO [M:0;jenkins-hbase4:41405] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41405,1676181809253; zookeeper connection closed. 2023-02-12 06:03:35,939 ERROR [Listener at localhost/37311-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4d4aa2c4 rejected from java.util.concurrent.ThreadPoolExecutor@49753fb5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:35,940 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): master:41405-0x100472092180000, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:03:35,940 ERROR [Listener at localhost/37311-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2575eec8 rejected from java.util.concurrent.ThreadPoolExecutor@49753fb5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:36,039 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): regionserver:41881-0x100472092180001, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:03:36,039 INFO [RS:0;jenkins-hbase4:41881] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41881,1676181809304; zookeeper connection closed. 2023-02-12 06:03:36,039 ERROR [Listener at localhost/37311-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@34a0a9d9 rejected from java.util.concurrent.ThreadPoolExecutor@40471612[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:36,039 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): regionserver:41881-0x100472092180001, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:03:36,039 ERROR [Listener at localhost/37311-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4c8550af rejected from java.util.concurrent.ThreadPoolExecutor@40471612[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:36,039 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@501384c3] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@501384c3 2023-02-12 06:03:36,139 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): regionserver:36993-0x100472092180002, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:03:36,139 INFO [RS:1;jenkins-hbase4:36993] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36993,1676181809334; zookeeper connection closed. 2023-02-12 06:03:36,139 ERROR [Listener at localhost/37311-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6c7352c5 rejected from java.util.concurrent.ThreadPoolExecutor@34931cc4[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:36,140 DEBUG [Listener at localhost/37311-EventThread] zookeeper.ZKWatcher(600): regionserver:36993-0x100472092180002, quorum=127.0.0.1:50136, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 06:03:36,140 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@11749bde] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@11749bde 2023-02-12 06:03:36,140 ERROR [Listener at localhost/37311-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@114783aa rejected from java.util.concurrent.ThreadPoolExecutor@34931cc4[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 06:03:36,140 INFO [Listener at localhost/37311] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-12 06:03:36,140 WARN [Listener at localhost/37311] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 06:03:36,144 INFO [Listener at localhost/37311] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 06:03:36,254 WARN [BP-492784036-172.31.14.131-1676181808682 heartbeating to localhost/127.0.0.1:42309] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 06:03:36,254 WARN [BP-492784036-172.31.14.131-1676181808682 heartbeating to localhost/127.0.0.1:42309] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-492784036-172.31.14.131-1676181808682 (Datanode Uuid e7487037-994b-46a5-96e5-181b07e10252) service to localhost/127.0.0.1:42309 2023-02-12 06:03:36,255 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e687fc21-5a6e-91dc-b0d3-6ec9f9eb174b/cluster_60f29b24-5f67-db61-c7a2-746bd106df0f/dfs/data/data3/current/BP-492784036-172.31.14.131-1676181808682] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 06:03:36,255 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e687fc21-5a6e-91dc-b0d3-6ec9f9eb174b/cluster_60f29b24-5f67-db61-c7a2-746bd106df0f/dfs/data/data4/current/BP-492784036-172.31.14.131-1676181808682] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 06:03:36,258 WARN [Listener at localhost/37311] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 06:03:36,297 INFO [Listener at localhost/37311] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 06:03:36,398 WARN [BP-492784036-172.31.14.131-1676181808682 heartbeating to localhost/127.0.0.1:42309] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 06:03:36,399 WARN [BP-492784036-172.31.14.131-1676181808682 heartbeating to localhost/127.0.0.1:42309] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-492784036-172.31.14.131-1676181808682 (Datanode Uuid 6b06b136-49f1-4ae3-9ebb-e70d71797601) service to localhost/127.0.0.1:42309 2023-02-12 06:03:36,400 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e687fc21-5a6e-91dc-b0d3-6ec9f9eb174b/cluster_60f29b24-5f67-db61-c7a2-746bd106df0f/dfs/data/data1/current/BP-492784036-172.31.14.131-1676181808682] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 06:03:36,400 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/e687fc21-5a6e-91dc-b0d3-6ec9f9eb174b/cluster_60f29b24-5f67-db61-c7a2-746bd106df0f/dfs/data/data2/current/BP-492784036-172.31.14.131-1676181808682] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 06:03:36,413 INFO [Listener at localhost/37311] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 06:03:36,526 INFO [Listener at localhost/37311] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-12 06:03:36,553 INFO [Listener at localhost/37311] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-12 06:03:36,570 INFO [Listener at localhost/37311] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=293 (was 271) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:42309 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:42309 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/37311 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:42309 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (901374678) connection to localhost/127.0.0.1:42309 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,41405,1676181809253)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:42309 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost:42309 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost:42309 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=595 (was 562) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=360 (was 318) - SystemLoadAverage LEAK? -, ProcessCount=170 (was 166) - ProcessCount LEAK? -, AvailableMemoryMB=3171 (was 4164)